-- Logs begin at Wed 2022-08-31 23:50:58 UTC, end at Thu 2022-09-01 00:51:44 UTC. -- Sep 01 00:21:26.179544 dv-cinder-820027-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 00:21:26.188155 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 00:21:26 2022] *** Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: nodename: dv-cinder-820027-21-iscsi Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: machine: x86_64 Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: clock source: unix Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: pcre jit disabled Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: detected number of CPU cores: 4 Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: current working directory: / Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: detected binary path: /usr/bin/uwsgi-core Sep 01 00:21:26.190248 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: your processes number limit is 47680 Sep 01 00:21:26.190862 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: your memory page size is 4096 bytes Sep 01 00:21:26.190862 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: detected max file descriptor number: 2048 Sep 01 00:21:26.190862 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: lock engine: pthread robust mutexes Sep 01 00:21:26.190862 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: thunder lock: enabled Sep 01 00:21:26.190862 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 00:21:26.190862 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 00:21:26.230641 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: Python main interpreter initialized at 0x5653f05459c0 Sep 01 00:21:26.230641 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: python threads support enabled Sep 01 00:21:26.230641 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: your server socket listen backlog is limited to 100 connections Sep 01 00:21:26.230641 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: your mercy for graceful operations on workers is 90 seconds Sep 01 00:21:26.231005 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 00:21:26.231086 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: *** Operational MODE: preforking *** Sep 01 00:21:26.231318 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: *** uWSGI is running in multiple interpreter mode *** Sep 01 00:21:26.231318 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: spawned uWSGI master process (pid: 117118) Sep 01 00:21:26.231519 dv-cinder-820027-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 00:21:26.232623 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: spawned uWSGI worker 1 (pid: 117119, cores: 1) Sep 01 00:21:26.232623 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: spawned uWSGI worker 2 (pid: 117120, cores: 1) Sep 01 00:21:26.232623 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 00:21:26.894909 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 00:21:26.902537 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 00:21:27.986366 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:21:27.986366 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: from cryptography.utils import int_from_bytes Sep 01 00:21:27.986961 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:21:27.986961 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: from cryptography.utils import int_from_bytes Sep 01 00:21:27.991749 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:21:27.991749 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: from cryptography.utils import int_from_bytes Sep 01 00:21:27.992179 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:21:27.992179 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: from cryptography.utils import int_from_bytes Sep 01 00:21:30.481399 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 00:21:30.481961 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 00:21:30.482171 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 00:21:30.482574 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 00:21:30.482783 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 00:21:30.483169 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.483498 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.483820 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.484144 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.484472 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.484810 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.485136 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.485457 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.485783 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.486046 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.486365 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.486686 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-21-iscsi {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.486772 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 00:21:30.487135 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.487220 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 00:21:30.487307 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.487553 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 00:21:30.487640 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.487906 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.488002 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 00:21:30.488166 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 00:21:30.488252 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.488554 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.488687 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.489050 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.489155 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.489315 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.489399 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.489531 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.489851 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490078 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490238 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490378 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490684 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490786 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490879 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.490949 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.491170 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.491290 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.491439 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.491543 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.491756 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.491867 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.492084 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-21-iscsi {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.492196 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.492416 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.492552 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.492758 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.492854 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.493072 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.493181 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-21-iscsi {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.493396 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.493494 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.493705 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.493793 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.494032 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.494132 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.494343 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.494458 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.494770 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.494856 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.495079 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.495175 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.495397 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.495480 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.495722 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.495816 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.496027 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.496123 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.496352 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.496438 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.496695 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.496784 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497016 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497123 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497330 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497629 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497721 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.497941 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.498028 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.498249 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.498349 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-21-iscsi {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.498568 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.498655 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.498900 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499008 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499166 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499310 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499394 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499659 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499757 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.499976 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500075 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500291 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500379 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500642 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500733 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500896 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.500992 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.501136 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.501283 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.501450 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.501615 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.501770 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.501939 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502079 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502263 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502380 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502594 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502723 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502901 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.502993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.503214 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.503313 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.503530 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.503618 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.503855 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.503944 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.504164 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.504265 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.504473 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.504584 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.504764 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.504871 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.505077 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.505178 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.505403 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.505490 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.506241 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.506337 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.506570 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.506721 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.506811 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.506983 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.507079 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.507297 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.507396 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.507637 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.507732 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.507958 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.508045 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.508269 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.508365 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.508605 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.508697 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.508920 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509009 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509228 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509419 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509535 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509622 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509842 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.509928 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.510150 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.510238 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.510471 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.510567 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.510775 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.510872 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511026 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511141 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511331 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511432 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511634 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511728 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.511951 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.512094 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.512256 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.512352 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.512583 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.512674 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.512894 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513057 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513194 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513325 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513501 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513641 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513807 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.513966 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.514113 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.514290 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.514419 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.514602 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.514730 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.514912 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515033 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515224 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515339 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515547 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515643 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515884 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.515977 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.516198 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.516286 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.516453 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.516580 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.516785 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.516884 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.517093 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.517199 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.517416 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.517503 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.517727 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.517815 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518038 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518124 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518343 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518429 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518644 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518730 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.518956 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519050 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519256 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519343 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519558 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519657 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519865 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.519964 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.520170 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.520262 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.520473 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.520582 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.520808 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.520908 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.521107 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.521194 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.522048 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.522152 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.522430 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.522540 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.522739 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.522832 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523048 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523135 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523356 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523452 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523662 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523758 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.523967 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.524056 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.524274 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.524376 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.524612 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.524717 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.524921 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525010 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525222 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525310 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525626 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525851 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.525989 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.526158 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.526246 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.526466 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.526561 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.526787 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.526914 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.527091 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.527185 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.527397 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.527496 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.527710 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.527800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.528029 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.528125 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.528341 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.528428 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.528677 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.528778 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.528987 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.529075 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.529297 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.529392 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.529606 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.529710 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.529914 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.530011 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.530223 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.530310 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.530532 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.530633 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.530836 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.530924 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.531147 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.531232 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.531467 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.531563 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.531777 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.531862 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.532094 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.532222 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.532402 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.532531 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.532750 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.532845 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:21:30.533068 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.533173 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.533380 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.533469 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.533697 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.533793 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534025 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534113 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534352 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534441 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534661 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534774 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.534995 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.535091 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.535315 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.535404 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.535652 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.535749 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.535959 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.536057 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.536278 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.536374 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.536618 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.536709 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.536960 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.537289 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.537440 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.537583 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.537583 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.537849 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.537992 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538146 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538283 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538419 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538556 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538701 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538837 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.538985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.539121 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.539256 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.539442 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.539660 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.539801 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.539980 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.540140 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.540298 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.540432 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.540635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.540772 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.540950 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.541096 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.541287 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.541425 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.541603 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.541749 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.541927 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542085 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542306 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542397 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542547 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542647 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542865 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.542952 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.543177 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.543267 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.543490 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.543591 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.543802 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.543890 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.544112 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.544209 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.544418 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.544565 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.544748 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.544837 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.545059 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.545147 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.545364 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.545454 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.545682 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.545770 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546008 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546103 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546316 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546405 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546649 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546745 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.546957 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547045 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547270 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547362 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547580 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547666 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547888 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.547975 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.548193 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.548281 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.548522 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.548614 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.548837 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.548927 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.549139 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.549226 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.549449 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.549536 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.549758 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.549861 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550063 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550152 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550374 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550459 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550678 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550775 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.550986 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.551081 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.551301 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.551399 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.551610 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.551706 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.551919 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.552006 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.552231 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.552339 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.552626 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.552762 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.552941 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.553075 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.553259 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.553394 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.553572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.553710 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.553890 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.554053 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.554206 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.554386 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.554518 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.554694 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.554847 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.555140 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.555228 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.555461 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.555584 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.555789 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.555907 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.556103 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.556219 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.556416 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.556553 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.556765 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.556852 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.557083 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.557170 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.557401 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.557494 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.557720 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.557816 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558038 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558125 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558342 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558433 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558647 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558734 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.558951 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559047 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559255 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559344 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559580 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559669 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559889 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.559977 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.560196 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.560285 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.560519 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.560611 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.560826 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.560930 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.561170 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.561264 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.561474 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.561559 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.561786 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.561882 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.562098 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.562193 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.562409 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.562496 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.562723 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.562825 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563034 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563123 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563346 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563432 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563654 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563824 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.563962 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.564048 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.564271 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.564360 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.564618 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.564721 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.564930 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.565016 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.565243 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.565551 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.565648 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.565861 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.566045 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.566218 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.566366 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.566533 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.566694 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.566880 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567009 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567220 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567333 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567547 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567647 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.567976 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.568725 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.568964 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.569072 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.569351 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.569437 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.569668 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.569754 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.569986 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.570087 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.570304 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.570392 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.570631 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.570719 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.570949 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571044 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571274 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571361 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571585 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571681 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571901 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.571999 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.572215 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.572308 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.572552 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.572644 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.572863 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.572962 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.573175 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.573261 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.573499 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.573587 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.573810 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.573899 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.574132 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.574229 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.574440 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.574538 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.574754 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.574843 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.575071 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.575164 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.575387 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.575474 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.575701 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.575787 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576014 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576101 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576330 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576664 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576753 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.576979 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577068 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577292 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577390 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577600 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577699 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577906 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.577993 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.578218 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.578315 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.578536 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.578633 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.578844 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.578931 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.579152 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.579248 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.579459 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.579549 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.579777 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.579863 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.580087 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.580193 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.580392 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.580481 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.580720 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.580821 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581035 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581123 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581349 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581443 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581661 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581756 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.581969 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582056 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582277 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582367 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582585 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582681 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582892 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.582980 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.583203 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.583291 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.583512 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.583606 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.584363 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.584522 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.584831 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.584958 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.585142 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.585281 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.585491 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.585580 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.585807 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.585895 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.586113 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.586210 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.586432 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.586527 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.586755 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.586843 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.587068 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.587164 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.587384 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.587481 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.587695 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.587793 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588005 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588112 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588328 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588416 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588665 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588757 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.588973 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589071 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589283 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589371 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589592 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589681 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589900 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.589996 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.590211 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.590308 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.590533 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.590627 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.590842 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.590931 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.591154 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.591242 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.591464 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.591550 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.591768 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.591864 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.592079 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.592177 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.592391 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.592487 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.592743 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.592978 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.593068 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.593315 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.593403 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.593639 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.593728 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.593960 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.594047 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.594270 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.594370 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.594586 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.594677 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.595165 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.595273 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.595480 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.595568 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.595796 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.595894 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.596111 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.596199 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.596420 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.596536 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.596768 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.596867 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.597077 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.597163 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.597391 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.597639 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.597728 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.597978 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.598066 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.598282 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.598369 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.598594 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.598695 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.598900 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.599004 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.599207 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.599307 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.599551 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.599662 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.599853 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600002 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600167 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600336 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600472 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600629 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600805 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.600948 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.601110 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.601260 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.601431 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.601572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.601739 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.601889 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.602044 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.602200 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.602347 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.602510 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.602650 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.602824 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603045 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603154 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603293 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603433 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603632 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603724 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.603959 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.604048 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.604302 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.604403 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.604638 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.604731 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.604948 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605036 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605265 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605368 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605569 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605655 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605874 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.605962 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.606196 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.606295 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.606490 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.606578 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.606795 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.606889 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.607096 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.607183 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.607407 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.607495 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.607721 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.607872 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608019 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608156 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608323 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608470 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608651 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608742 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.608960 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609050 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609264 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609352 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609578 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609666 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609888 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.609977 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.610191 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.610278 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.610495 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.610603 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.610806 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.610895 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.611114 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.611202 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.611418 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.611516 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.611728 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.611817 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612033 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612129 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612345 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612440 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612670 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612758 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.612977 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613078 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613385 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613593 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613679 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613902 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.613991 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.614206 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.614295 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.614512 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.614599 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.614820 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.614907 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.615164 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.615327 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.615580 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.615669 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.615912 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616001 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616220 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616309 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616545 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616638 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616863 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.616951 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.617171 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.617260 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.617480 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.617567 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.617791 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.617934 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.618103 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.618192 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.618406 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.618502 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.618714 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.618876 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619017 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619111 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619327 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619415 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619634 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619730 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.619940 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620026 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620242 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620328 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620569 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620673 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620877 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.620973 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.621189 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.621275 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.621497 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.621585 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.621804 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.621901 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.622110 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.622198 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.622415 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.622514 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.622721 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.622816 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623031 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623122 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623340 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623428 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623653 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623740 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.623962 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.624050 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.624272 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.624361 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.624601 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.624693 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.624911 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625012 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625221 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625310 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625523 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625611 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625840 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.625937 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.626148 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.626234 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.626459 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.626546 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.626763 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.626860 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.627068 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.627163 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.627390 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.627478 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.627702 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.627803 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628013 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628109 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628337 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628425 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628682 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628785 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.628998 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.629085 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.629301 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.629387 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.629611 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.629700 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.629918 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.630003 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.630225 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.630311 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.630535 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.631152 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.631356 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.631449 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.631669 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.631757 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.631982 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.632079 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.632293 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.632382 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.632628 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.632735 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.632943 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633033 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633249 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633346 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633560 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633660 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633869 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.633957 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.634172 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.634260 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.634493 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.634594 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.634797 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.634886 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.635104 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.635193 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.635412 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.635507 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.635715 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.635801 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636025 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636113 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636329 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636425 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636667 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636773 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.636992 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.637080 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.637307 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.637404 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.637616 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.637711 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.637928 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638016 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638244 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638342 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638554 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638642 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638863 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.638950 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.639169 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.639260 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.639474 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.639586 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.639789 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.639885 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.640098 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.640187 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.640414 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.640596 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.640748 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.640906 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.641178 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.641276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.641496 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.641584 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.641812 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.641913 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.642115 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.642202 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.642421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.642510 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.642727 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.642823 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.643043 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.643130 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.643345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.643435 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.643659 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.643763 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.644072 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.644160 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.644384 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.644477 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.644712 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.644801 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645028 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645115 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645339 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645426 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645645 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645742 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.645961 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.646049 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.646835 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647039 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647158 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647372 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647460 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647681 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647777 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.647998 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.648095 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.648311 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.648408 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.648657 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.648750 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.648983 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.649110 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.649295 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.649430 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.649610 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.649741 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.649914 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.650158 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.650261 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.650474 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.650563 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.650791 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.650879 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.651117 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.651214 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.651443 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.651557 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.651773 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.651882 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.652084 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.652181 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.652405 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.652510 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.652745 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.652833 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.653071 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.653176 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.653399 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.653496 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.653715 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.653805 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654023 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654119 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654329 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654416 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654650 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654749 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.654957 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.655047 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.655272 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.655360 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.655582 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.655678 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.655891 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.656002 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.656195 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.656334 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.656543 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.656679 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.656845 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657015 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657150 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657347 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657471 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657658 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657786 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.657972 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.658108 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.658294 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.658440 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.658606 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.658744 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.658916 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659068 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659246 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659377 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659548 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659684 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659859 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.659987 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.660175 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.660292 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.660489 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.660648 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.660820 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.660964 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.661129 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.661258 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.661455 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.661588 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.661763 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.662212 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.662329 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.662535 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.662653 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.662874 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.662965 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.663203 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.663291 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.663524 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.663623 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.663844 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.663934 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.664173 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.664263 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.664478 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.664633 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.664806 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.664902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.665117 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.665219 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.665419 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.665507 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.665723 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.665811 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666029 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666125 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666338 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666426 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666641 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666729 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.666944 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667042 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667248 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667336 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667570 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667668 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667875 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.667976 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.668197 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.668287 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.668520 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.668627 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.668833 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.668923 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.669137 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.669226 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.669439 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.669526 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.669781 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.669875 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.670083 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.670179 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.670392 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.670478 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.670706 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.670805 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671013 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671101 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671322 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671409 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671631 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671729 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.671944 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.672032 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.672254 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.672351 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.672600 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.672704 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.672913 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673008 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673223 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673321 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673531 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673618 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673836 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.673968 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.674153 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.674249 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.674467 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.674555 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.674796 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.674984 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.675111 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.675318 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.675440 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.675636 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.675764 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.675953 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.676086 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.676268 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.676407 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.676607 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.676752 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.676925 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.677077 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.677239 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.677397 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.677602 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.677915 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678004 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678226 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678322 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678553 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678641 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678875 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.678976 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.679203 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.679304 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.679538 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.679752 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.679839 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.680089 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.680179 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.680410 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.680518 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.680766 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.680853 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.681086 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.681175 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.681407 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.681504 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.681727 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.681826 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682043 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682130 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682358 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682453 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682671 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682768 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.682984 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.683072 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.683298 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.683388 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.683612 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.683711 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.683925 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684062 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684241 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684338 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684578 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684685 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684895 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.684991 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.685209 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.685297 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.685528 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.685628 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.685863 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.685951 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.686185 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.686283 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.686496 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.686582 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.686808 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.686895 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.687124 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.687226 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.687449 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.687644 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.687769 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.687964 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.688089 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.688298 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.688395 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.688648 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.688739 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.688978 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.689147 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.689298 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.689387 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.689616 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.689704 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.689945 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690047 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690255 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690345 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690564 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690652 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690876 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.690974 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.691187 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.691276 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.691493 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.691589 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.691813 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.691911 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.692128 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.692337 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.692431 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.692686 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.692790 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.693026 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.693610 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.694087 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.694196 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.694421 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.694521 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.694745 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.694834 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.695071 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.695159 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.695394 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.695545 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.695707 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.695801 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696012 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696100 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696329 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696424 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696660 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696749 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.696971 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697059 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697288 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697379 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697599 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697687 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697908 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.697998 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.698217 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.698317 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.698529 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.698618 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.698842 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.699068 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.699166 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.699422 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.699523 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.699738 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.699824 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.700065 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.700155 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.700371 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.700458 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.700699 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.700802 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701006 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701097 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701316 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701408 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701621 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701708 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.701923 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702023 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702228 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702324 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702532 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702620 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702844 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.702933 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.703148 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.703236 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.703457 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.703545 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.703761 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.703898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.704069 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.704163 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.704375 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.704480 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.704706 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.704804 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705040 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705135 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705353 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705451 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705658 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705749 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.705963 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706052 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706285 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706389 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706583 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706670 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706890 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.706985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.707201 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.707299 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.707508 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.707605 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.707831 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.707920 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.708140 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.708274 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.708455 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.708778 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.708914 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.709116 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.709244 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.709442 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.709544 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.709755 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.709843 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.710102 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.710199 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.710413 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.710521 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.710722 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.710812 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711027 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711127 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711348 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711438 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711658 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711747 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.711971 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.712061 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.712282 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.712370 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.712623 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.712755 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.712933 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.713034 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.713245 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.713344 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.713555 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.713806 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.713915 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.714148 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.714265 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.714465 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.714561 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.714776 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.714874 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.715087 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.715184 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.715396 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.715502 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.715705 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.715803 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.716018 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.716124 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.716458 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.716689 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.716795 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717005 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717101 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717318 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717423 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717737 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.717944 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.718043 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.718256 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.718372 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.718567 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.718659 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.718876 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.719012 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.719187 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.719355 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.719501 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.719589 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.719815 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.720155 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.720370 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.720472 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.720708 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.720810 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.721024 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.721121 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.721345 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.721434 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.721689 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.721784 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722014 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722103 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722338 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722427 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722656 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722743 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.722971 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.723059 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.723285 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.723382 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.723594 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.723680 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.723905 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.724001 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.724220 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.724308 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.725093 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.725197 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.725461 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.725558 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.725773 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.725901 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.726078 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.726217 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.726386 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.726639 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.726730 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.726962 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727051 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727289 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727387 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727590 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727678 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727896 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.727985 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.728206 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.728304 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.728546 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.728641 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.728834 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.728923 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.729139 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.729251 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.729442 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.729532 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.729755 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.729843 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730059 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730148 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730365 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730454 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730668 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730788 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.730973 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.731100 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.731276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.731414 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.731581 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.731727 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.731891 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.732043 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.732194 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.732369 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.732512 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.732756 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.732861 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733023 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733112 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733333 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733422 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733653 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733743 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.733966 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734054 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734277 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734364 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734588 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734678 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.734986 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.735214 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.735305 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.735521 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.735611 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.735836 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.735955 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.736147 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.736247 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.736458 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.736592 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.736793 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.736891 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.737103 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.737202 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.737417 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.737506 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.737725 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.737814 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738034 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738136 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738339 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738454 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738649 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738744 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.738953 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.739049 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.739280 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.739374 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.739605 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.739693 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.739915 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.740080 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.740288 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.740533 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.740631 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.740726 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.740959 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.741051 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.741277 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.741373 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.741670 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.741758 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742001 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742092 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742313 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742400 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742628 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742714 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.742937 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743026 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743250 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743338 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743563 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743660 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743877 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.743965 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.744188 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.744275 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.744524 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.744629 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.744838 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.744926 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.745159 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.745271 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.745487 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.745587 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.745799 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.745906 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.746112 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.746203 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.746438 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.746527 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.746762 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.746849 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.747082 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.747168 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.747399 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.747497 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.747732 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.747822 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.748051 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.748139 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.748367 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.748462 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.748705 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.748819 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.749012 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.749198 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.749333 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 00:21:30.749427 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.749643 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.749960 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.750278 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.750603 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.750923 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.751258 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.751592 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.751909 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.752242 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.752599 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.752955 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.753276 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.753628 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.753961 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.754281 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.754601 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.754913 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:21:30.755160 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 00:21:30.906093 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO dbcounter [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Registered counter for database nova_api Sep 01 00:21:30.910392 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO dbcounter [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Registered counter for database nova_api Sep 01 00:21:30.925848 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:30.930531 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-5aebb157-b829-4999-8319-34536390fc12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:30.933037 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writer thread running {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:30.937121 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writer thread running {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:30.989790 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.context [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e166cc96-51e7-4aca-853f-51af32260464(cell1) {{(pid=117119) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 00:21:30.994088 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:21:30.994555 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:21:30.994793 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.context [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e166cc96-51e7-4aca-853f-51af32260464(cell1) {{(pid=117120) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 00:21:30.996102 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:21:30.996852 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:21:30.997296 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:21:30.998614 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:21:30.999087 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:21:30.999230 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:21:31.000676 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:21:31.001292 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO dbcounter [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Registered counter for database nova_cell0 Sep 01 00:21:31.001392 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:21:31.001820 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:21:31.003783 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_concurrency.lockutils [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:21:31.005264 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO dbcounter [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Registered counter for database nova_cell1 Sep 01 00:21:31.006567 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO dbcounter [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Registered counter for database nova_cell0 Sep 01 00:21:31.010617 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO dbcounter [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Registered counter for database nova_cell1 Sep 01 00:21:31.014113 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:31.015109 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:31.017589 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-5aebb157-b829-4999-8319-34536390fc12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:31.019650 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writer thread running {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:31.022881 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-5aebb157-b829-4999-8319-34536390fc12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:31.023507 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writer thread running {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:31.156124 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writer thread running {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:31.164830 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writer thread running {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:31.165954 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO dbcounter [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Registered counter for database nova_cell0 Sep 01 00:21:31.172580 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_db.sqlalchemy.engines [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:31.173451 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO dbcounter [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Registered counter for database nova_cell0 Sep 01 00:21:31.177105 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writer thread running {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:31.180692 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG oslo_db.sqlalchemy.engines [None req-5aebb157-b829-4999-8319-34536390fc12 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:21:31.185282 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writer thread running {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:21:31.516306 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-5aebb157-b829-4999-8319-34536390fc12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:21:31.517689 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:21:31.524418 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:21:31.525637 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:21:31.870412 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-5aebb157-b829-4999-8319-34536390fc12 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:21:31.871308 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:21:31.876411 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: WARNING keystonemiddleware.auth_token [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:21:31.877260 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: WARNING keystonemiddleware.auth_token [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:21:31.881910 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653f05459c0 pid: 117120 (default app) Sep 01 00:21:31.883561 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5653f05459c0 pid: 117119 (default app) Sep 01 00:21:31.883987 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5aebb157-b829-4999-8319-34536390fc12 None None] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:21:31.885221 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5aebb157-b829-4999-8319-34536390fc12 None None] 10.222.0.25 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001798 Sep 01 00:21:31.885618 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 788 bytes} [Thu Sep 1 00:21:31 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:22:49.842397 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:22:49.843920 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002227 Sep 01 00:22:49.844341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:22:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:22:49.855685 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_api:SELECT=3 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:49.856826 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_cell0:SELECT=3 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:49.857842 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_cell1:SELECT=3 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:49.858701 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:50.775039 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-47f515b4-f6b8-4c31-8d05-c74095591628 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:22:50.808084 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-47f515b4-f6b8-4c31-8d05-c74095591628 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.957510 Sep 01 00:22:50.808920 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 2/3] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 00:22:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:22:53.222097 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:22:53.223755 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-c891dac4-8d8e-4ae4-b43f-c69e5b4654af None None] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002410 Sep 01 00:22:53.224369 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 2/4] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:22:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:22:53.668838 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-45633124-0ffe-40c5-bb23-d152ea7e0d29 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "id": "c1", "ram": 256, "disk": 1, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:22:53.723461 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-45633124-0ffe-40c5-bb23-d152ea7e0d29 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.490827 Sep 01 00:22:53.724104 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 3/5] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:22:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:22:53.967759 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-b4a8e891-95ff-4923-9cdf-409c355498a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:22:53.974863 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_api:SELECT=3 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:53.975651 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_cell1:SELECT=3 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:53.976572 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_cell0:SELECT=3 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:53.977263 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:22:54.035334 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-b4a8e891-95ff-4923-9cdf-409c355498a9 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.302154 Sep 01 00:22:54.035937 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 3/6] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 00:22:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:22:56.403229 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-45633124-0ffe-40c5-bb23-d152ea7e0d29 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:22:56.404262 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-45633124-0ffe-40c5-bb23-d152ea7e0d29 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 01 00:22:56.404703 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 4/7] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:22:57.114736 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7ca5dc94-22d2-43da-aa55-89cfb050864c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "swap": 0, "disk": 5, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:22:57.169882 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7ca5dc94-22d2-43da-aa55-89cfb050864c admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757246 Sep 01 00:22:57.171056 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 4/8] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:22:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:22:57.185497 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-9f9725e0-ec77-4bda-b947-3ab0e0a334cf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:22:57.225497 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-9f9725e0-ec77-4bda-b947-3ab0e0a334cf admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043953 Sep 01 00:22:57.226256 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 5/9] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 00:22:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:22:59.643908 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-7ca5dc94-22d2-43da-aa55-89cfb050864c admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:22:59.644881 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-7ca5dc94-22d2-43da-aa55-89cfb050864c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Sep 01 00:22:59.645295 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:22:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:00.055731 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e557b431-6deb-451d-b790-51416863647b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "disk": 10}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:00.073836 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e557b431-6deb-451d-b790-51416863647b admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.422354 Sep 01 00:23:00.074478 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 6/11] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:22:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 00:23:00.087197 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-20a12cc1-b4b0-44ca-a49d-37653eab90f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:00.111855 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-20a12cc1-b4b0-44ca-a49d-37653eab90f2 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028252 Sep 01 00:23:00.112415 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 6/12] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 00:23:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:02.518127 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-e557b431-6deb-451d-b790-51416863647b admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:02.519143 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-e557b431-6deb-451d-b790-51416863647b admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 01 00:23:02.519738 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 7/13] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:03.085817 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-16a43f86-dfd9-4d8b-b648-4e9ffb0bccf3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "os-flavor-access:is_public": true, "swap": 0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:03.107114 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-16a43f86-dfd9-4d8b-b648-4e9ffb0bccf3 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.580986 Sep 01 00:23:03.107954 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 7/14] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:23:03.120022 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-cf374597-de7a-4f49-b656-69e613ef71a1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:03.145061 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-cf374597-de7a-4f49-b656-69e613ef71a1 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028755 Sep 01 00:23:03.145773 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 8/15] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 00:23:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:05.534345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-16a43f86-dfd9-4d8b-b648-4e9ffb0bccf3 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:05.535453 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-16a43f86-dfd9-4d8b-b648-4e9ffb0bccf3 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 01 00:23:05.536058 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 8/16] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:05.975020 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5217d8a6-b742-4716-9b7b-9b30360a76d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:05.994659 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5217d8a6-b742-4716-9b7b-9b30360a76d6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452153 Sep 01 00:23:05.996550 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 9/17] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 00:23:06.008025 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-3b66b4d5-c4a8-4ce7-a242-a7a093bb88b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:06.034417 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-3b66b4d5-c4a8-4ce7-a242-a7a093bb88b5 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030103 Sep 01 00:23:06.035001 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 9/18] 10.222.0.25 () {64 vars in 1336 bytes} [Thu Sep 1 00:23:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:08.675950 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5217d8a6-b742-4716-9b7b-9b30360a76d6 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:08.677052 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5217d8a6-b742-4716-9b7b-9b30360a76d6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001551 Sep 01 00:23:08.677471 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 10/19] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:09.125070 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-46c72069-64aa-45a4-a0bc-d7a6139ea867 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:09.151103 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-46c72069-64aa-45a4-a0bc-d7a6139ea867 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.467360 Sep 01 00:23:09.151644 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 00:23:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:11.587740 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-5217d8a6-b742-4716-9b7b-9b30360a76d6 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:11.588833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-5217d8a6-b742-4716-9b7b-9b30360a76d6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Sep 01 00:23:11.589255 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 11/21] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:23:12.061481 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0a5fbe61-f858-4ea4-92cf-8fc34ae036f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "id": "1"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:12.086287 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0a5fbe61-f858-4ea4-92cf-8fc34ae036f6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.486454 Sep 01 00:23:12.086939 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 11/22] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:11 2022] POST /compute/v2.1/flavors => generated 402 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 00:23:12.105227 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-32e63632-7301-43e0-bee7-f4a8827f648e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:12.132368 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-32e63632-7301-43e0-bee7-f4a8827f648e admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030918 Sep 01 00:23:12.133005 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 12/23] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 00:23:12 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:14.545627 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-0a5fbe61-f858-4ea4-92cf-8fc34ae036f6 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:14.546656 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-0a5fbe61-f858-4ea4-92cf-8fc34ae036f6 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Sep 01 00:23:14.547074 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 12/24] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:23:14.990142 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f7a49634-8765-40ce-96b1-ac55ebc31175 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "2"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:15.012799 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f7a49634-8765-40ce-96b1-ac55ebc31175 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.459150 Sep 01 00:23:15.013382 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 13/25] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:23:15.027664 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-aebaee90-bde8-4f90-90c4-bc63ce1338be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:15.056905 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-aebaee90-bde8-4f90-90c4-bc63ce1338be admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033981 Sep 01 00:23:15.057511 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 13/26] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 00:23:15 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:17.414722 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-f7a49634-8765-40ce-96b1-ac55ebc31175 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:17.415745 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-f7a49634-8765-40ce-96b1-ac55ebc31175 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 01 00:23:17.416184 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:17.844463 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-77bb8597-7361-4c79-8ac5-38b4fd6fabe0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "vcpus": 2}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:17.865069 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-77bb8597-7361-4c79-8ac5-38b4fd6fabe0 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.442546 Sep 01 00:23:17.865630 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 14/28] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:17 2022] POST /compute/v2.1/flavors => generated 406 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 00:23:17.878603 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-89708e5a-f7ac-4217-9ca7-f859bbd6058f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:17.903512 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-89708e5a-f7ac-4217-9ca7-f859bbd6058f admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029637 Sep 01 00:23:17.904087 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 15/29] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 00:23:17 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:20.272099 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-77bb8597-7361-4c79-8ac5-38b4fd6fabe0 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:20.273402 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-77bb8597-7361-4c79-8ac5-38b4fd6fabe0 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001746 Sep 01 00:23:20.273955 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 15/30] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:20.686398 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2a3dddfb-516c-418c-8fde-beedc37d6a67 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "4", "ram": 8192, "vcpus": 4, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "os-flavor-access:is_public": true}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:20.693962 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:20.708894 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2a3dddfb-516c-418c-8fde-beedc37d6a67 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426474 Sep 01 00:23:20.710199 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 16/31] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 00:23:20.724626 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-1aa8e533-efdc-4838-b37d-8427de593850 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:20.749488 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-1aa8e533-efdc-4838-b37d-8427de593850 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028627 Sep 01 00:23:20.750924 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 16/32] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 00:23:20 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:23:23.149991 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2a3dddfb-516c-418c-8fde-beedc37d6a67 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:23.152869 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2a3dddfb-516c-418c-8fde-beedc37d6a67 admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.007514 Sep 01 00:23:23.153510 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 17/33] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:23 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:23.632472 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-68c16d7a-03f9-4eaa-99e1-ecfd196b17bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:23.652535 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-68c16d7a-03f9-4eaa-99e1-ecfd196b17bb admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.491333 Sep 01 00:23:23.653335 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 17/34] 10.222.0.25 () {64 vars in 1283 bytes} [Thu Sep 1 00:23:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:23:23.665673 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-6150251c-0f11-49bf-b92c-e56c663c6bc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:23.691656 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-6150251c-0f11-49bf-b92c-e56c663c6bc6 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029892 Sep 01 00:23:23.692239 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 18/35] 10.222.0.25 () {64 vars in 1333 bytes} [Thu Sep 1 00:23:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:23:45.914757 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-68c16d7a-03f9-4eaa-99e1-ecfd196b17bb admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:45.915693 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-68c16d7a-03f9-4eaa-99e1-ecfd196b17bb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 01 00:23:45.916101 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 18/36] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:23:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:45.926477 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:46.317851 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-a8a8e3b7-0100-49ee-a18b-075b812c8a21 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:46.336912 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-a8a8e3b7-0100-49ee-a18b-075b812c8a21 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414875 Sep 01 00:23:46.337440 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 19/37] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 00:23:45 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:47.513840 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-68c16d7a-03f9-4eaa-99e1-ecfd196b17bb admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:47.515442 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-68c16d7a-03f9-4eaa-99e1-ecfd196b17bb admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Sep 01 00:23:47.515841 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 19/38] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:48.043270 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2297e3ab-92cf-4ece-9efd-2669d5b6f3ba admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:48.049594 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-2297e3ab-92cf-4ece-9efd-2669d5b6f3ba admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2297e3ab-92cf-4ece-9efd-2669d5b6f3ba admin admin] Request method failure captured: Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Accept: application/json Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Accept-Encoding: gzip, deflate Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Connection: keep-alive Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Content-Length: 0 Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Host: 10.222.0.25 Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Openstack-Api-Version: compute 2.90 Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: User-Agent: python-novaclient Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABjD_uTCcld8Jl5PGWob-4jbrBZfpZQqPZIU3MLpZkLohMNepnsmCPWJbzb-MKJZLquqx41I0SIgPtQtNQIyZoSZ1RxKggVJD8BsdForxrVlYoFhaITFFCCXnNqYLwF8qfM964sUzW52oKU-w-T7Kn37R5hJlwPHqGyK_Qyo1rsmoNjcx4 Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Domain-Id: None Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Domain-Name: None Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Name: admin Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Role: member,reader,admin Sep 01 00:23:48.052833 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Roles: member,reader,admin Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6a8f68ec23146108279fe93631f855a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}] Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant: admin Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant-Name: admin Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User: admin Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Id: 6789433c4ccf40c89d963e435a40ba65 Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Name: admin Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: method: > Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: exception: Flavor 42 could not be found. Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: action_args: {'id': '42'} Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:23:48.054504 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:48.055540 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.056898 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-2297e3ab-92cf-4ece-9efd-2669d5b6f3ba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:23:48.058194 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-2297e3ab-92cf-4ece-9efd-2669d5b6f3ba admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.396049 Sep 01 00:23:48.058194 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 20/39] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 00:23:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:48.063962 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e3602c9b-27e0-4262-9471-7ed87a922d35 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:48.068080 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:23:48.087491 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e3602c9b-27e0-4262-9471-7ed87a922d35 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027231 Sep 01 00:23:48.088017 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 20/40] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 00:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:48.098576 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c437de7c-a28b-407a-bceb-107482f1e2fe admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:48.120390 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c437de7c-a28b-407a-bceb-107482f1e2fe admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025343 Sep 01 00:23:48.120950 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 21/41] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 00:23:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:48.131260 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a47aa0a7-8c60-42c3-bd11-c5af826841d7 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:48.137573 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-a47aa0a7-8c60-42c3-bd11-c5af826841d7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a47aa0a7-8c60-42c3-bd11-c5af826841d7 admin admin] Request method failure captured: Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Accept: application/json Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Accept-Encoding: gzip, deflate Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Connection: keep-alive Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Content-Length: 0 Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Host: 10.222.0.25 Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Openstack-Api-Version: compute 2.90 Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: User-Agent: python-novaclient Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABjD_uTCcld8Jl5PGWob-4jbrBZfpZQqPZIU3MLpZkLohMNepnsmCPWJbzb-MKJZLquqx41I0SIgPtQtNQIyZoSZ1RxKggVJD8BsdForxrVlYoFhaITFFCCXnNqYLwF8qfM964sUzW52oKU-w-T7Kn37R5hJlwPHqGyK_Qyo1rsmoNjcx4 Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Domain-Id: None Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Domain-Name: None Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Name: admin Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Role: member,reader,admin Sep 01 00:23:48.141345 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Roles: member,reader,admin Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6a8f68ec23146108279fe93631f855a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}] Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant: admin Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant-Name: admin Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User: admin Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Id: 6789433c4ccf40c89d963e435a40ba65 Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Name: admin Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: method: > Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: exception: Flavor 42 could not be found. Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: action_args: {'id': '42'} Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:23:48.142985 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:48.143993 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:48.145276 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-a47aa0a7-8c60-42c3-bd11-c5af826841d7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:23:48.146503 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-a47aa0a7-8c60-42c3-bd11-c5af826841d7 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015786 Sep 01 00:23:48.146503 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 21/42] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 00:23:48 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:49.118148 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-c437de7c-a28b-407a-bceb-107482f1e2fe admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:49.119198 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-c437de7c-a28b-407a-bceb-107482f1e2fe admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 01 00:23:49.119601 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 22/43] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:49.637059 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-631806ee-f346-47f2-ba58-3a2098f097d6 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:49.642301 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-631806ee-f346-47f2-ba58-3a2098f097d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-631806ee-f346-47f2-ba58-3a2098f097d6 admin admin] Request method failure captured: Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Accept: application/json Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Accept-Encoding: gzip, deflate Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Connection: keep-alive Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Content-Length: 0 Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Host: 10.222.0.25 Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Openstack-Api-Version: compute 2.90 Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: User-Agent: python-novaclient Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABjD_uVEroOUvEloJXYHTbM6b6IAcytPeT0k0MROOnviWJxZB_z1IxRerlrCEvSx_UL9ruuC4-pIertVl-uFmmSYwr1kmgsMSTXt9F4ie0ikFI9fSWC5CtKMC3e-fGrtFsKvLAuc6bKVH_QMS1pNztPXxbQqNHQOvIHgud_hN2eGhiQwcw Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Domain-Id: None Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Domain-Name: None Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Name: admin Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Role: member,reader,admin Sep 01 00:23:49.643800 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Roles: member,reader,admin Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6a8f68ec23146108279fe93631f855a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}] Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant: admin Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant-Name: admin Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User: admin Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Id: 6789433c4ccf40c89d963e435a40ba65 Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Name: admin Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: method: > Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: exception: Flavor 84 could not be found. Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: action_args: {'id': '84'} Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:23:49.645350 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:49.646341 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-631806ee-f346-47f2-ba58-3a2098f097d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:23:49.648939 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-631806ee-f346-47f2-ba58-3a2098f097d6 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.389536 Sep 01 00:23:49.648939 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 00:23:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:49.654902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8c96fc95-dbd0-4f03-a8c0-d9f44c026727 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:49.671365 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8c96fc95-dbd0-4f03-a8c0-d9f44c026727 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019996 Sep 01 00:23:49.671838 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 23/45] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 00:23:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:49.681169 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fd6ee0f8-f688-4870-8b04-efef78105fac admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:49.696910 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fd6ee0f8-f688-4870-8b04-efef78105fac admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019298 Sep 01 00:23:49.697431 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 00:23:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:49.706543 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7552b07e-a1a2-4ace-b9b0-e86a3326643c admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:49.711753 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-7552b07e-a1a2-4ace-b9b0-e86a3326643c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7552b07e-a1a2-4ace-b9b0-e86a3326643c admin admin] Request method failure captured: Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Accept: application/json Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Accept-Encoding: gzip, deflate Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Connection: keep-alive Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Content-Length: 0 Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Host: 10.222.0.25 Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Openstack-Api-Version: compute 2.90 Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: User-Agent: python-novaclient Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABjD_uVEroOUvEloJXYHTbM6b6IAcytPeT0k0MROOnviWJxZB_z1IxRerlrCEvSx_UL9ruuC4-pIertVl-uFmmSYwr1kmgsMSTXt9F4ie0ikFI9fSWC5CtKMC3e-fGrtFsKvLAuc6bKVH_QMS1pNztPXxbQqNHQOvIHgud_hN2eGhiQwcw Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Domain-Id: None Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Domain-Name: None Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Name: admin Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Role: member,reader,admin Sep 01 00:23:49.713286 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Roles: member,reader,admin Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6a8f68ec23146108279fe93631f855a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}] Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant: admin Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant-Name: admin Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User: admin Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Id: 6789433c4ccf40c89d963e435a40ba65 Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Name: admin Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: method: > Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: exception: Flavor 84 could not be found. Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: action_args: {'id': '84'} Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:23:49.714876 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:49.715902 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:49.717572 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-7552b07e-a1a2-4ace-b9b0-e86a3326643c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:23:49.718839 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-7552b07e-a1a2-4ace-b9b0-e86a3326643c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011690 Sep 01 00:23:49.718839 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 24/47] 10.222.0.25 () {60 vars in 1190 bytes} [Thu Sep 1 00:23:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 01 00:23:50.674704 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-fd6ee0f8-f688-4870-8b04-efef78105fac admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:50.675710 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-fd6ee0f8-f688-4870-8b04-efef78105fac admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 01 00:23:50.676112 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 24/48] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:51.195663 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b362d8a7-67e1-4e40-a101-0ae7c8c2461e admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:51.201380 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.wsgi [None req-b362d8a7-67e1-4e40-a101-0ae7c8c2461e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b362d8a7-67e1-4e40-a101-0ae7c8c2461e admin admin] Request method failure captured: Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Accept: application/json Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Accept-Encoding: gzip, deflate Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Connection: keep-alive Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Content-Length: 0 Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Host: 10.222.0.25 Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Openstack-Api-Version: compute 2.90 Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Openstack-System-Scope: None Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: User-Agent: python-novaclient Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Auth-Token: gAAAAABjD_uWG5rKI7HXH2wGytSl1jAKfSO8X1Q1-NtzOYznQRk0ehXQ7yliX1566tZPLwM10YS64H9FsXNYZfNU1F-OtOO2F7JZAhTYCunlV5Yuf4GgG37bPkkrC4_JJA9wyPuXuQxp6OUN5Ve52U-BRRX1Qmc4ILfAvSwI6he508vbRsckDqI Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Domain-Id: None Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Domain-Name: None Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Identity-Status: Confirmed Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Is-Admin-Project: True Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Domain-Id: default Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Domain-Name: Default Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Project-Name: admin Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Role: member,reader,admin Sep 01 00:23:51.202887 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Roles: member,reader,admin Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6a8f68ec23146108279fe93631f855a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}] Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant: admin Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-Tenant-Name: admin Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User: admin Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Domain-Id: default Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Domain-Name: Default Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Id: 6789433c4ccf40c89d963e435a40ba65 Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: X-User-Name: admin Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: method: > Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: exception: Flavor 451 could not be found. Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: action_args: {'id': '451'} Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:23:51.204431 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:51.205321 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.206434 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-b362d8a7-67e1-4e40-a101-0ae7c8c2461e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:23:51.207507 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-b362d8a7-67e1-4e40-a101-0ae7c8c2461e admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390659 Sep 01 00:23:51.207507 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 25/49] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 00:23:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:51.213974 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-f20f5fde-896a-4e8b-89b4-64da1fa3edc0 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:51.229404 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-f20f5fde-896a-4e8b-89b4-64da1fa3edc0 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019040 Sep 01 00:23:51.230106 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 25/50] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 00:23:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:51.239871 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:51.255335 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019020 Sep 01 00:23:51.255880 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 26/51] 10.222.0.25 () {60 vars in 1210 bytes} [Thu Sep 1 00:23:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:23:51.265093 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2b0e96ad-9420-4bcd-9ac9-090750040caa admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:51.270396 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.wsgi [None req-2b0e96ad-9420-4bcd-9ac9-090750040caa admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2b0e96ad-9420-4bcd-9ac9-090750040caa admin admin] Request method failure captured: Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Accept: application/json Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Accept-Encoding: gzip, deflate Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Connection: keep-alive Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Content-Length: 0 Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Host: 10.222.0.25 Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Openstack-Api-Version: compute 2.90 Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Openstack-System-Scope: None Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: User-Agent: python-novaclient Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Auth-Token: gAAAAABjD_uWG5rKI7HXH2wGytSl1jAKfSO8X1Q1-NtzOYznQRk0ehXQ7yliX1566tZPLwM10YS64H9FsXNYZfNU1F-OtOO2F7JZAhTYCunlV5Yuf4GgG37bPkkrC4_JJA9wyPuXuQxp6OUN5Ve52U-BRRX1Qmc4ILfAvSwI6he508vbRsckDqI Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Domain-Id: None Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Domain-Name: None Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Identity-Status: Confirmed Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Is-Admin-Project: True Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Openstack-Nova-Api-Version: 2.90 Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Domain-Id: default Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Domain-Name: Default Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Project-Name: admin Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Role: member,reader,admin Sep 01 00:23:51.271873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Roles: member,reader,admin Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f6a8f68ec23146108279fe93631f855a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f6a8f68ec23146108279fe93631f855a"}]}] Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant: admin Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant-Id: f6a8f68ec23146108279fe93631f855a Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-Tenant-Name: admin Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User: admin Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Domain-Id: default Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Domain-Name: Default Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Id: 6789433c4ccf40c89d963e435a40ba65 Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: X-User-Name: admin Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: method: > Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: exception: Flavor 451 could not be found. Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: action_args: {'id': '451'} Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:23:51.273421 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:51.274357 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: ERROR nova.api.openstack.wsgi Sep 01 00:23:51.275425 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-2b0e96ad-9420-4bcd-9ac9-090750040caa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=117119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:23:51.276449 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-2b0e96ad-9420-4bcd-9ac9-090750040caa admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011704 Sep 01 00:23:51.276449 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 26/52] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 00:23:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 01 00:23:52.268150 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:52.269213 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 01 00:23:52.269605 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 27/53] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:52.789953 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-dd243db2-5fe7-4d78-8881-b00dfd6dae42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:52.809221 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-dd243db2-5fe7-4d78-8881-b00dfd6dae42 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.401953 Sep 01 00:23:52.809763 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 27/54] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 00:23:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:23:53.775324 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:53.776326 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Sep 01 00:23:53.776756 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 28/55] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:54.300418 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-cbc33615-ddd8-49b1-92e9-2d555dedb776 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:54.318771 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-cbc33615-ddd8-49b1-92e9-2d555dedb776 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.402910 Sep 01 00:23:54.319311 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 28/56] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 00:23:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:23:55.292237 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:55.293282 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 01 00:23:55.293677 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 29/57] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:55.824393 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-205945b3-5d17-4f16-aa0f-d7631cef8a28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:55.844913 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-205945b3-5d17-4f16-aa0f-d7631cef8a28 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.413071 Sep 01 00:23:55.845453 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 29/58] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 00:23:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:23:56.810717 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:56.811736 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 00:23:56.812134 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 30/59] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:57.394084 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4476521a-6b37-40c2-91e7-859834df4793 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:23:57.416358 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4476521a-6b37-40c2-91e7-859834df4793 admin admin] 10.222.0.25 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.454388 Sep 01 00:23:57.417224 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 30/60] 10.222.0.25 () {64 vars in 1235 bytes} [Thu Sep 1 00:23:56 2022] POST /compute/v2.1/flavors => generated 409 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 01 00:23:58.438606 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:58.439606 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 01 00:23:58.440001 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 31/61] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:23:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:23:58.961389 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-d39c4b93-2327-48e8-9c29-ce059cc8e9a2 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:23:58.982797 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-d39c4b93-2327-48e8-9c29-ce059cc8e9a2 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404938 Sep 01 00:23:58.983214 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 31/62] 10.222.0.25 () {60 vars in 1202 bytes} [Thu Sep 1 00:23:58 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:24:52.008215 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:24:52.009173 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-79b22be9-8939-4e80-b24e-0785fe4f90cf admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 01 00:24:52.009571 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 32/63] 10.222.0.25 () {54 vars in 931 bytes} [Thu Sep 1 00:24:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:24:52.020138 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:52.400960 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-4236b23e-6fa4-420b-984f-0eac88400849 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:24:52.423249 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-4236b23e-6fa4-420b-984f-0eac88400849 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407483 Sep 01 00:24:52.423795 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 32/64] 10.222.0.25 () {60 vars in 1292 bytes} [Thu Sep 1 00:24:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:24:52.444781 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG dbcounter [-] [117120] Writing DB stats nova_api:SELECT=14 {{(pid=117120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:24:52.448715 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-8d661487-ebdf-4d9e-9ec2-d72e922d1380 admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:24:52.456167 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-8d661487-ebdf-4d9e-9ec2-d72e922d1380 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013081 Sep 01 00:24:52.456718 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 33/65] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Sep 1 00:24:52 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:24:52.468897 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-386dfe7a-a8ca-4265-9317-9510dfa83ed4 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:24:52.476508 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-386dfe7a-a8ca-4265-9317-9510dfa83ed4 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011459 Sep 01 00:24:52.477031 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 33/66] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Sep 1 00:24:52 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:24:52.488821 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:24:52.496752 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011353 Sep 01 00:24:52.497265 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 34/67] 10.222.0.25 () {60 vars in 1286 bytes} [Thu Sep 1 00:24:52 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:24:52.508715 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-e9ee3739-fe93-4675-b156-5dd34ba6d694 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:24:52.516808 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-e9ee3739-fe93-4675-b156-5dd34ba6d694 admin admin] 10.222.0.25 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011639 Sep 01 00:24:52.517321 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 34/68] 10.222.0.25 () {60 vars in 1283 bytes} [Thu Sep 1 00:24:52 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:27:48.041319 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:27:48.042365 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 01 00:27:48.042761 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:27:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:27:48.187113 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_api:SELECT=6 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:27:48.346873 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:27:48.350535 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:27:48.351006 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:27:48.351433 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:27:48.352144 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:27:48.352622 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:27:48.353038 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:27:48.386316 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-29e34c5b-04e1-4caa-b1cf-7fa12eebce7f admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.200788 Sep 01 00:27:48.386874 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 35/70] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 00:27:48 2022] GET /compute/v2.1/os-services => generated 794 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:27:49.222650 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:27:49.223690 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Sep 01 00:27:49.224281 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 36/71] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:27:49.416230 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:27:49.419651 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:27:49.420127 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:27:49.420591 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:27:49.421335 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:27:49.421782 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:27:49.422231 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:27:49.441367 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-10a44e69-3a56-442e-8569-626f413c3ad0 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.077070 Sep 01 00:27:49.441897 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 36/72] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 00:27:49 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:28:00.668280 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:28:00.669339 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 01 00:28:00.669743 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 37/73] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:28:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:28:00.813109 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_cell0:SELECT=4 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:28:00.813818 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_cell1:SELECT=4 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:28:00.814412 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG dbcounter [-] [117119] Writing DB stats nova_api:SELECT=8 {{(pid=117119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:28:00.863499 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:28:00.866848 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:28:00.867316 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:28:00.867744 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:28:00.868450 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:28:00.868918 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:28:00.869336 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:28:00.893746 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-83e4df4e-3693-48c3-b64c-d9ce2d80b720 admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.085009 Sep 01 00:28:00.894228 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 37/74] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 00:28:00 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:28:01.722904 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: DEBUG nova.api.openstack.wsgi [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] Calling method '>' {{(pid=117120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:28:01.723911 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: INFO nova.api.openstack.requestlog [None req-829a1097-b071-4209-991c-0583b097e65c admin admin] 10.222.0.25 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 01 00:28:01.724307 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: [pid: 117120|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1074 bytes} [Thu Sep 1 00:28:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:28:01.917929 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG nova.api.openstack.wsgi [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Calling method '>' {{(pid=117119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:28:01.921317 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:28:01.921795 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:28:01.922255 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:28:01.922970 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:28:01.923412 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:28:01.923829 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: DEBUG oslo_concurrency.lockutils [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:28:01.946223 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: INFO nova.api.openstack.requestlog [None req-76d642be-c0eb-4253-a684-b2cd113f2bcc admin admin] 10.222.0.25 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.080532 Sep 01 00:28:01.946704 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: [pid: 117119|app: 0|req: 38/76] 10.222.0.25 () {60 vars in 1193 bytes} [Thu Sep 1 00:28:01 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:29:00.113538 dv-cinder-820027-21-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 01 00:29:00.114133 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: Thu Sep 1 00:29:00 2022 - graceful shutdown triggered... Sep 01 00:29:00.114588 dv-cinder-820027-21-iscsi devstack@n-api.service[117120]: Gracefully killing worker 2 (pid: 117120)... Sep 01 00:29:00.114983 dv-cinder-820027-21-iscsi devstack@n-api.service[117119]: Gracefully killing worker 1 (pid: 117119)... Sep 01 00:29:01.115012 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: worker 1 buried after 1 seconds Sep 01 00:29:01.115497 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: worker 2 buried after 1 seconds Sep 01 00:29:01.115497 dv-cinder-820027-21-iscsi devstack@n-api.service[117118]: goodbye to uWSGI. Sep 01 00:29:01.116665 dv-cinder-820027-21-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 01 00:29:01.117235 dv-cinder-820027-21-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 01 00:29:01.120074 dv-cinder-820027-21-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 01 00:29:01.129254 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 00:29:01 2022] *** Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: nodename: dv-cinder-820027-21-iscsi Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: machine: x86_64 Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: clock source: unix Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: pcre jit disabled Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: detected number of CPU cores: 4 Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: current working directory: / Sep 01 00:29:01.131279 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: detected binary path: /usr/bin/uwsgi-core Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: your processes number limit is 47680 Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: your memory page size is 4096 bytes Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: detected max file descriptor number: 2048 Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: lock engine: pthread robust mutexes Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: thunder lock: enabled Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 01 00:29:01.131903 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 00:29:01.171764 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: Python main interpreter initialized at 0x56137b8289c0 Sep 01 00:29:01.171764 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: python threads support enabled Sep 01 00:29:01.171764 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: your server socket listen backlog is limited to 100 connections Sep 01 00:29:01.171764 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: your mercy for graceful operations on workers is 90 seconds Sep 01 00:29:01.172158 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 00:29:01.172250 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: *** Operational MODE: preforking *** Sep 01 00:29:01.172455 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: *** uWSGI is running in multiple interpreter mode *** Sep 01 00:29:01.172455 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: spawned uWSGI master process (pid: 132483) Sep 01 00:29:01.172716 dv-cinder-820027-21-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 01 00:29:01.173654 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: spawned uWSGI worker 1 (pid: 132496, cores: 1) Sep 01 00:29:01.173654 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: spawned uWSGI worker 2 (pid: 132498, cores: 1) Sep 01 00:29:01.173654 dv-cinder-820027-21-iscsi devstack@n-api.service[132483]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 00:29:01.837448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 00:29:01.845551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 01 00:29:03.002084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:29:03.002084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: from cryptography.utils import int_from_bytes Sep 01 00:29:03.002826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:29:03.002826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: from cryptography.utils import int_from_bytes Sep 01 00:29:03.008061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:29:03.008061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: from cryptography.utils import int_from_bytes Sep 01 00:29:03.008643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 00:29:03.008643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: from cryptography.utils import int_from_bytes Sep 01 00:29:05.509973 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 00:29:05.510512 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 00:29:05.510962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 00:29:05.511069 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 00:29:05.511289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 00:29:05.513467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.513998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.514299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.514507 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.514829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.515161 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-21-iscsi {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.515670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.515988 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.516315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.516678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.516991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.517325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.517651 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.518174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.520958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.521862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.522206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.523127 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.523406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.524148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.525189 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.526141 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.527057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.527874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.528940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-21-iscsi {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.529804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.530615 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.531250 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.531862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.532333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.532822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.533311 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.533807 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.534280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.534849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.535424 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.536055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.536573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.537052 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.537508 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.538065 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.538550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.539023 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.539514 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.539918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.540406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.541417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.541908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.542396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.542823 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.543237 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.543718 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.544215 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.544745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.545222 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.545688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.546185 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.546665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.547148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.547630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.548100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.549229 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.549734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.550219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.551323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.551894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.552550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.552965 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.553452 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.553961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.554462 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.554944 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.555434 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.555924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.556405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.556917 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.557617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.558407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.559260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.560066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.560905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.561732 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.562572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.563418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.564030 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.564361 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.564721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.565046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.565377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.565700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.566587 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.567073 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.567398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.567717 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.568038 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.568359 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.568719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.569060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.569396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.569715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.570033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.570350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.570668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.570999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.571314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.571629 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.571958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.572274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.572612 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.572989 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.573258 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.573572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.573935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.574384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.574701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.575028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.575344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.575656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.575985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.576277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.576609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 00:29:05.577039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.577124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 00:29:05.577203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.577388 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.577529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 00:29:05.577627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.577751 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 00:29:05.577844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.578006 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 00:29:05.578127 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.578402 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.578500 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.578725 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.578816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.579992 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.580151 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.580312 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.580455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.580657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.580800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.580986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.581129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.581268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.581406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.581788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.582659 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.582659 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.582840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-21-iscsi {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.582913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.582913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.583133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.583225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.583408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.583408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.583677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.583814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.583959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.584098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.584248 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.584437 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.584582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.584972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.585068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.585499 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.585606 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.585823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.586138 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.586237 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.586454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.586782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.586873 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.587291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.587423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.587617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.587947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.588093 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.588298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.588601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.589067 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.589248 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.589461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.589789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-21-iscsi {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.590135 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.590579 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.590682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.590774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.590850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.590953 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.591267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.592262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.592370 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.592466 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.592595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.592595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.592748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.592748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.592883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.593012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.593325 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.593653 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.594013 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.594303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.594421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.594669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.595033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.595313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.595538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.595707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.595900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.596022 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.596273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.596353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.596615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.596715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.597046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.597213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.597365 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.597713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.597876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.598022 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.598217 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.598342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.598650 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.598764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.598988 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.599178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.599308 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.599636 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.599727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.599963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.600268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.600374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.600626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.600861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.600967 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.601256 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.601359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.601570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.601735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.601884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.602199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.602290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.602517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.602831 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.602922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.603164 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.603342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.603506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.603802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.603907 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.604148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.604398 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.604536 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.604800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.604987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.605125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.605430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.605542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.605742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.605849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.606064 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.606165 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.606387 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.606487 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.606708 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.606986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.607156 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.607324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.607572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.607748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.607952 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.608187 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.608332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.608624 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.608736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.608932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.609146 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.609319 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.609474 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.25 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.609640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.609821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.25 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.609979 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.610151 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.610309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.610477 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.610646 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.610816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.610987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.611161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.611355 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.611616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.611714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.611851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.611940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.612086 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.612187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.612282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.612572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.612681 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.613329 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.613434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.613530 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.613838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.613957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.614159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.614269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.614469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.614779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.614880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.615098 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.615304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.615469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.615593 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.615697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.615940 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.616054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.616257 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.616390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.616598 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.616707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.616918 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.617109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.617213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.617530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.617783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.617946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.618180 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.618304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.618497 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.618812 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.618917 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.619121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.619432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.619533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.619741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.620004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.620106 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.620356 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.620705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.620800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.621019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.621301 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.621395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.621623 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.621931 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.622078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.622251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.622383 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.622557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.622723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.622865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.623066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.623169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.623402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.623556 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.623725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.623958 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.624124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.624286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.624456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.624638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.624734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.624840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.624993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.625159 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.625307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.625442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.625628 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.625778 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.625957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.626103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.626281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.626419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.626618 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.626757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.626943 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.627087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.627272 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.627411 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.627571 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.627721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.627951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.628101 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.628258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.628564 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.628719 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.628819 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.628946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.629038 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.629280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.629384 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.629596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.629689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.629918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.630011 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.630236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.630337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.630541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.630640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.630856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.630954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 00:29:05.631172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.631273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.631497 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.631589 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.631816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.631929 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.632139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.632242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.632456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.632642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.632818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.632928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.633132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.633308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.633444 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.633534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.633762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.634852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635262 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635536 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.635948 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636034 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636516 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636841 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.636937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.637160 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.637266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.637475 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.637576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.637792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.637928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.638121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.638263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.638430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.638626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.638811 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.638954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.639093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.639176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.639345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.639487 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.639728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.639949 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.640107 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.640271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.640418 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.640624 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.640764 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.640951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.641126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.641288 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.641430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.641600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.641742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.641911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.642059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.642244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.642381 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.643304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.643479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.643630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.643630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.643925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.644640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.644760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645497 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645909 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.645995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.646149 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.646268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.646595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.646687 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.646910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.647227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.647318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.647550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.647818 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.647918 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.648242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.648453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.648587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.648792 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.649100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.649207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.649417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.649717 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.649811 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651122 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651347 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651725 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651821 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.651919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652560 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.652959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.653128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.653297 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.653458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.653704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.653815 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.654044 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.654307 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.654427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.654670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.654855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.654999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.655180 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.655535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.655649 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.655925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.656115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.656249 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.656605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.656716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.656936 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.657209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.657311 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.657620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.657735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.657977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.658258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.658525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.658686 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.658874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.659015 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.659166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.659317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.659470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.660328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.660473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.660675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.660991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.661138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.661302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.661540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.661688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.661922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.662104 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.662255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.662531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.662683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.662833 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.663151 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.663288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.663465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.663724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.663874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.664331 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.664522 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.664677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.664815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.664961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665244 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665398 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665753 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.665956 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666355 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.666999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.667213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.667357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.667534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.667729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.667854 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.667992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.668138 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.668240 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.668445 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.668576 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.668784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.668902 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.669093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.669230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.669411 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.669538 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.669721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.669820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670027 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.670955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671890 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.671999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.672199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.672345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.672548 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.672644 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.672866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.672972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.673178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.673371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.673490 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.673627 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.673810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.673994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.674165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.674333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.674481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.674614 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.674773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.674939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.675099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.675195 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.675396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.675516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.675758 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.675929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.676142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.676302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.676472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.676690 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.676876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.677041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.677199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.677366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.677528 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.677678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.677851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.678002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.678160 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.678312 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.678469 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.678697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.678886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.679058 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.679230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.679384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.679384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.679695 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.679853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680798 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.680959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.681077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.681247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.681350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.681557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.681704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.681868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.682032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.682184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.682376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.682491 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.682726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.682833 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.683038 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.683131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.683354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.683447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.683675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.683784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684107 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684322 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684425 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684657 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.684969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.685070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.685280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.685468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.685632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.685773 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.685941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686556 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.686961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.687181 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.687273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.687490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.687583 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.687801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.687893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.688108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.688200 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.688418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.688531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.688753 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.688856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.689058 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.689149 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.689361 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.689501 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.689672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.689772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690021 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690731 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.690962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.691170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.691329 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.691486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.691654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.691759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.691887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693152 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693510 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.693844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694016 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694274 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.694915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.695017 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.695226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.695317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.695538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.695639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.696955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697298 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697383 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697476 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.697810 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698011 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698499 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698635 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698728 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.698963 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.699059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.699342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.699445 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.699661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.699752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.699972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.700063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.700277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.701976 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702065 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702857 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.702978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.703330 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.703444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.703666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.703998 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.704100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.704316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.704621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.704740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.704947 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.705214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.705307 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.705551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.705857 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.705958 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.706161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.706470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.707126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.707429 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.707583 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.708873 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709135 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709250 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709380 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709496 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.709929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.710015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.710109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.710109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.710252 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.711350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.711448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.711601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.711728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.711850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.711963 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.712097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.712097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.712268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.712372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.712372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.713960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714379 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.714762 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.715054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.715236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.715389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.715714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.715817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.716049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.716368 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.716515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.716825 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.716918 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.717147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.717457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.717556 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.717800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.718047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.718140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.718422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.718594 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.718740 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.719056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.719156 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.719370 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.719636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.719728 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.720001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.720167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.720320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.720665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.720760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.720986 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.721254 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.721631 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.721631 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.721848 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.721935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.722222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.722343 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.722512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.722678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.722939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.723107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.723281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.723451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.723662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.723769 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.723865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.724030 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.724188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.724366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.724542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.724716 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.724844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.725035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.725189 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.725346 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.725448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.725659 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.725760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726016 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726661 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726753 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.726984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.727083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.727300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.727449 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.727616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.727708 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.727934 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.728028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.728251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.728352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.728597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.728693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.728912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729014 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729243 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729644 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.729969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.730185 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.730286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.730498 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.730605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.730810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.730911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.731325 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.731473 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.731597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.731710 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.731710 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.731878 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732015 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732326 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.732974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.733075 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.733282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.733385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.733591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.733730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.733903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734298 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.734908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.735125 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.735225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.735432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.735532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.735759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.735860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.736070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.736177 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.736375 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.736541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.736706 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.736803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.737010 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.737110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.737359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.737452 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.737676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.738315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.738570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.738663 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.738881 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.738982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.739199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.739338 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.739520 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.739621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.739834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.739935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.740147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.740248 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.740462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.740774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.740872 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.741097 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.741301 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.741406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.741634 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.741873 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.742032 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.742198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.742347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.742514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.742674 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.742847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743232 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743846 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.743952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.744072 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.744203 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.744407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.744529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.744769 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.744863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.745104 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.745207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.745424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.745514 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.745734 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.745835 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.746979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.747072 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.747292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.747393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.747604 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.747696 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.747917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.748008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.748229 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.748330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.748575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.748662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.748897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749024 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749275 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.749926 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.750132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.750225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.750438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.750530 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.750751 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.750852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.751060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.751361 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.751502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.751702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.751803 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.752046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.752152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.752377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.752478 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.752724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.752816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.753039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.753133 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.753354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.754243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.754351 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.754450 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.754549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.754778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.754942 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.755125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.755256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.755465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.755572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.755801 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.755894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.756129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.758592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.758592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.758780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.758877 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.758974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.758974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759301 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759393 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.759897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760128 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760635 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.760849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761040 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761361 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761488 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.761764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762023 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.762983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.763088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.763309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.763407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.763634 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.763725 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.763945 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764746 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.764994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.765210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.765310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.765524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.765625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.765836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.765927 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.766147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.766238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.766481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.766580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.766797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.766889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.767113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.767221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.767426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.767531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.767807 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.767919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.768057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.768149 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.768367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.768468 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.768702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.768805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.769182 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.769301 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.769388 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.769555 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.769693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.769944 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770036 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770262 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770577 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.770979 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.771197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.771289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.771506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.771608 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.771831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772160 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.772957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.773116 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.773277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.773457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.773619 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.773759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.773944 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.774083 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.774262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.774396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.774619 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.774727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.774939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.775032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.775282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.775492 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.775627 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.775838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.775939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.776172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.776346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.776541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.776637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.776890 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.776995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.777205 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.777300 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.777509 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.777607 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.777824 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.777926 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.778145 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.778236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.778464 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.778568 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.778786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.778885 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.779094 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.779186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.779400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.779498 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.779725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.779857 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.780018 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.780130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.780321 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.780434 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.780651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.780772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781016 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781672 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.781873 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.782894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.783109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.783207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.783417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.783509 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.783722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.783814 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.784026 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.784126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.784371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.784463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.784812 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.784922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.785115 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.785222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.785534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.785673 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.785852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.785944 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.786177 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.786296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.786491 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.786620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.786812 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.786946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.787186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.787329 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.787450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.787560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.787741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.787859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.788061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.788192 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.788371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.788489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.788714 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.788832 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.789033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.789152 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.789932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790652 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.790908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791061 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791228 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791363 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791862 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.791971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.792179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.792318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.792543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.792655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.792827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.792928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.793146 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.793286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.793460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.793570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.793787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.793903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.794099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.794202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.794415 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.794518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.794726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.794845 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795034 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795657 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795753 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.795969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.796070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.796275 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.796367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.796611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.796721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.796925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797027 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797547 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797857 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.797968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.798173 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.798357 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.798498 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.798646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.798796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.798891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.799064 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.799168 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.799364 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.799465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.799672 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.799772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.800043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.800159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.800838 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.800953 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.801170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.801270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.801551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.801644 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.801868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.801962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.802198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.802333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.802514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.802653 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.802831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.802922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.803154 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.803354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.803477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.803674 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.803776 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.804013 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.804113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.804345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.804437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.804699 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.804792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805431 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.805965 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.806055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.806277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.806376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.806591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.806682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.806903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807631 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.807957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.808161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.808253 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.808472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.808581 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.808809 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.808920 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.809138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.809346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.809447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.809700 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.809790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810770 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.810980 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.811080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.811289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.811379 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.811607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.811711 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.811915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.812005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.812224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.812334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.812568 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.812724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.812883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813016 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813195 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.813907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.814127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.814225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.814434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.814526 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.814745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.814837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.815054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.815171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.815383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.815498 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.815692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.815796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.816010 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132496) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 00:29:05.816668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.817091 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.817492 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.817805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.818124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.818434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.818763 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.819060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.819368 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.819682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.819990 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.820305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.820658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.820937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.821520 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.822026 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.822295 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.822651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.822958 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.823332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.823646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.824018 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.824353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.824734 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.825095 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.825694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.826034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.826357 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.826696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.827030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.827340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.827649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.827963 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.828292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.828632 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.828947 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.829260 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.829575 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.829888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.830199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.830528 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.830821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.831130 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.831441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.831799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.832113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.832425 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.832762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.833080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.833424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.833744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.834065 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.834382 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.834966 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.835279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.835592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.835903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.836213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.836549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.836885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.837202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.837511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.837944 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.838257 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.838578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.838902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.839215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.839541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.839867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.840179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.840510 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.840837 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.841169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.841509 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.841842 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.842172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.842480 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.842786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.843095 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.843403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.843723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.844036 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.844341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.844669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.844982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.845288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.845590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.845894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.846200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.846509 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.846811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.847117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.847485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.847880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.848191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.848591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.848834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.849140 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.849444 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.849747 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.850049 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.850354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.850687 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.851022 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.851335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.851659 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.851969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.852293 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.852629 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.852955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.853277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.853593 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.853901 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.854235 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.854612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.854855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.855163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.855473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.855783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.856093 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.856418 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.856769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.857078 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.857405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.857728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.858047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.858362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.858673 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.859001 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.859310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.859619 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.859926 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.860234 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.860582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.860898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.861209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.861517 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.861832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.862145 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.862473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.863708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.863708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.863984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.864313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.864683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.865000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.865345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.865675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.865992 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.866304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.866611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 00:29:05.866852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=132498) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 00:29:05.879458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO dbcounter [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Registered counter for database nova_api Sep 01 00:29:05.899693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:05.906378 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writer thread running {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:05.929148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Registered counter for database nova_api Sep 01 00:29:05.949073 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:05.955876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:05.963998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.context [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e166cc96-51e7-4aca-853f-51af32260464(cell1) {{(pid=132496) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 00:29:05.968061 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:29:05.968562 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:29:05.970132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:29:05.970877 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:29:05.971325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:29:05.973981 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:29:05.975956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO dbcounter [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Registered counter for database nova_cell0 Sep 01 00:29:05.980071 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO dbcounter [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Registered counter for database nova_cell1 Sep 01 00:29:05.989442 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:05.994762 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writer thread running {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:06.017296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.context [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e166cc96-51e7-4aca-853f-51af32260464(cell1) {{(pid=132498) load_cells /opt/stack/nova/nova/context.py:464}} Sep 01 00:29:06.021308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:29:06.021776 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:29:06.023341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:29:06.024074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:29:06.024542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:29:06.026748 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:29:06.029052 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Registered counter for database nova_cell0 Sep 01 00:29:06.033222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Registered counter for database nova_cell1 Sep 01 00:29:06.041477 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:06.042802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:06.050120 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:06.052283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:06.132913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:06.140477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writer thread running {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:06.149856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO dbcounter [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Registered counter for database nova_cell0 Sep 01 00:29:06.157270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_db.sqlalchemy.engines [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132496) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:06.162593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writer thread running {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:06.202602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO dbcounter [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Registered counter for database nova_cell0 Sep 01 00:29:06.210557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_db.sqlalchemy.engines [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=132498) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 00:29:06.215433 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writer thread running {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 00:29:06.486295 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: WARNING keystonemiddleware.auth_token [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:29:06.494342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: WARNING keystonemiddleware.auth_token [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:29:06.535645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:29:06.542991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:29:06.840225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: WARNING keystonemiddleware.auth_token [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:29:06.846197 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: WARNING keystonemiddleware.auth_token [None req-f8f83426-2754-4a5a-ac6d-afb44dcb95db None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:29:06.852339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56137b8289c0 pid: 132496 (default app) Sep 01 00:29:06.888605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 01 00:29:06.894599 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: WARNING keystonemiddleware.auth_token [None req-010b6ff7-3b7b-43e7-9b0f-f2c2cfc83801 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 01 00:29:06.899830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56137b8289c0 pid: 132498 (default app) Sep 01 00:29:42.963902 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:42.963902 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:42.964946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:42.966474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:44.278463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8f96171f-b857-46fe-93bf-1480c7c1e737 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Action: 'create', calling method: .version_select at 0x7fcae4e081f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-275077222", "metadata": {"Type": "work"}}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:29:46.017433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8f96171f-b857-46fe-93bf-1480c7c1e737 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.076875 Sep 01 00:29:46.018723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 1/1] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 00:29:42 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3081 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 00:29:46.036358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.037348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.042718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.044427 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:29:46.433091 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e55a1334-5bc2-4a6e-ba0c-86c583e4a3b3 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Calling method '.version_select at 0x7fcae4e45ca0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:46.985305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e55a1334-5bc2-4a6e-ba0c-86c583e4a3b3 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e" status: 200 len: 353 microversion: 2.1 time: 0.956226 Sep 01 00:29:46.986858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 1/2] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:29:46 2022] GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e => generated 353 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:29:47.006210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2931cc0a-16af-401d-b77d-10b35de65d12 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Calling method '.version_select at 0x7fcae4cfb0d0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:47.091366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2931cc0a-16af-401d-b77d-10b35de65d12 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e" status: 200 len: 353 microversion: 2.1 time: 0.094507 Sep 01 00:29:47.094881 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:29:46 2022] GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:29:47.168178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f19c95e-417d-4686-a411-6439e5a2b3c9 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Calling method '.version_select at 0x7fcae4d1ff70>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:47.359470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f19c95e-417d-4686-a411-6439e5a2b3c9 tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e" status: 202 len: 0 microversion: 2.1 time: 0.253797 Sep 01 00:29:47.360025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:29:47 2022] DELETE /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:29:47.371412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-88b1f263-1337-45f5-a892-6d273d8551fe tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Calling method '.version_select at 0x7fcae4cfb790>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:47.513648 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-88b1f263-1337-45f5-a892-6d273d8551fe tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e" status: 200 len: 352 microversion: 2.1 time: 0.148612 Sep 01 00:29:47.514433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 3/5] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:29:47 2022] GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e => generated 352 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:29:48.528285 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bee6422a-d84c-4ae7-9dba-6d79074c14ae tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Calling method '.version_select at 0x7fcae4ce0670>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:48.578333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-bee6422a-d84c-4ae7-9dba-6d79074c14ae tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] HTTP exception thrown: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bee6422a-d84c-4ae7-9dba-6d79074c14ae tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Request method failure captured: Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e HTTP/1.1 Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_z2C8-286GU-UeTYFIBN37VHpGDMlPl1CONgdbi77sBpMoDFPzCs8NyjIeeNpxG0Qdlne3P6JpOsU9tONtqXP9lNU3gKuQOg4G5v8-RDrCBbR-fh3ftDNRzpEqOhdNMJW4QFAEEhEUcspdgdZezHa1bR0LUW_5X5nGFmWspU4iz4Xg Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 25fba38957464d34adbcc250cabbc8cd Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesGetTestJSON-1295250331 Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:29:48.585902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_25fba38957464d34adbcc250cabbc8cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/25fba38957464d34adbcc250cabbc8cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25fba38957464d34adbcc250cabbc8cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/25fba38957464d34adbcc250cabbc8cd"}]}] Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesGetTestJSON-1295250331 Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 25fba38957464d34adbcc250cabbc8cd Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesGetTestJSON-1295250331 Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesGetTestJSON-1295250331-project Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: da6eb6b18460435c93a914745d10aa7c Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesGetTestJSON-1295250331-project Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'f61a4b21-49de-4112-ab31-43da93505c5e'} Sep 01 00:29:48.587087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. (HTTP 404) (Request-ID: req-018e0f90-10fc-404a-903e-29b49226cd85) Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:29:48.587721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:29:48.588639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 00:29:48.589514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bee6422a-d84c-4ae7-9dba-6d79074c14ae tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] Returning 404 to user: Volume f61a4b21-49de-4112-ab31-43da93505c5e could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:29:48.590435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bee6422a-d84c-4ae7-9dba-6d79074c14ae tempest-VolumesGetTestJSON-1295250331 tempest-VolumesGetTestJSON-1295250331-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e" status: 404 len: 109 microversion: 2.1 time: 0.063148 Sep 01 00:29:48.593910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 3/6] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:29:48 2022] GET /compute/v2.1/os-volumes/f61a4b21-49de-4112-ab31-43da93505c5e => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:29:56.733310 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-174ee9e2-d43c-40e6-a76f-f96c0d648079 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4cfbe50>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:56.882927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-174ee9e2-d43c-40e6-a76f-f96c0d648079 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/db68b0d4-fb28-4717-bb9c-cacadd1c6615" status: 200 len: 351 microversion: 2.1 time: 0.163848 Sep 01 00:29:56.890710 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:29:56 2022] GET /compute/v2.1/os-volumes/db68b0d4-fb28-4717-bb9c-cacadd1c6615 => generated 351 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:29:58.875483 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f14d316e-197f-4eb7-9b7d-0f2c9ea04a52 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4c45790>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:29:58.972328 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f14d316e-197f-4eb7-9b7d-0f2c9ea04a52 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/1bf5907d-3e08-4ae0-8db8-b31fce4ec997" status: 200 len: 350 microversion: 2.1 time: 0.100923 Sep 01 00:29:58.976647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:29:58 2022] GET /compute/v2.1/os-volumes/1bf5907d-3e08-4ae0-8db8-b31fce4ec997 => generated 350 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:29:59.185384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1247951433", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:29:59.382685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] validate_networks() for [('7dac0ef3-49f5-4c90-b2ad-1bb41b9f1f0b', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:30:00.732070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-40928c84-929c-4606-98bb-166fb6063fb0 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4c45e50>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:00.894206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-40928c84-929c-4606-98bb-166fb6063fb0 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/b4016816-c867-49b7-9b85-38e0fb571b95" status: 200 len: 350 microversion: 2.1 time: 0.170444 Sep 01 00:30:00.907242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 5/9] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:30:00 2022] GET /compute/v2.1/os-volumes/b4016816-c867-49b7-9b85-38e0fb571b95 => generated 350 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:00.930402 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-316d64b9-d177-4d5f-89ab-3d451bf4e884 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4c454c0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:01.146743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-316d64b9-d177-4d5f-89ab-3d451bf4e884 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.235599 Sep 01 00:30:01.160432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 6/10] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Sep 1 00:30:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:01.167911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7902b9f1-9849-48dc-b68d-8568a56726d3 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4c450d0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:01.524005 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7902b9f1-9849-48dc-b68d-8568a56726d3 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.361370 Sep 01 00:30:01.545309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 7/11] 10.222.0.25 () {58 vars in 1149 bytes} [Thu Sep 1 00:30:01 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:02.098004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c02ebbcf-0833-4ac8-9b2d-5dc442e2a506 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: .version_select at 0x7fcae4c5c430>, body: {"keypair": {"name": "tempest-keypair-2104154925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGk9n9zEIYueeeJQka5N47d4S3HK0Wa8bWSKxfYeXkS14ysTGN8cpD5HwXLZ8Ite1r6L43fVjdQCfRWQ25IXEdpvEQuKplzQnTZo6exR2DJJhhslStQf4T27x9bEyUb7Lw=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:02.213602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-c02ebbcf-0833-4ac8-9b2d-5dc442e2a506 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for project f1064fc209674020b54fa7526cf22bf5. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:02.223744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-c02ebbcf-0833-4ac8-9b2d-5dc442e2a506 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for user 5bf265cb4af14e2d8815c42288e2a1f7 and project f1064fc209674020b54fa7526cf22bf5. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:02.314076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:30:02.315372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:30:02.316067 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:30:02.316716 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:30:02.317368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:30:02.336568 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c02ebbcf-0833-4ac8-9b2d-5dc442e2a506 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.788176 Sep 01 00:30:02.337427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:02.337897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 8/12] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:30:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:02.338684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:02.339646 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:02.340666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:02.341350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:02.341984 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:02.349921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6b4d7c50-5dc9-4d9e-adf1-9bea90ad3833 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4c29ca0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:02.474249 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:02.496063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for user a6f08eaef2d149a9b0236d4bcbe03a92 and project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:02.533539 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:30:02.540524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:30:02.596334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6b4d7c50-5dc9-4d9e-adf1-9bea90ad3833 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.254898 Sep 01 00:30:02.597579 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 9/13] 10.222.0.25 () {58 vars in 1134 bytes} [Thu Sep 1 00:30:02 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:02.715796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3954479e-b9cb-43d9-88c0-b2e95f5303cf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.741493 Sep 01 00:30:02.722160 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 5/14] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:29:58 2022] POST /compute/v2.1/servers => generated 383 bytes in 3749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 00:30:02.741587 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-31050750-a5d7-4768-8b69-33b8e8086618 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4bfc5e0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:03.384156 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-07b82441-3276-45ca-ae02-927158ecd7c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'create', calling method: .version_select at 0x7fcae4be91f0>, body: {"keypair": {"name": "tempest-keypair-1881809288", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQVmdmnZE/AqQx0ovr31JsdIQLHHSpsvcWIzT+iW9n02GiqYjE8H0sv5DHNad2mumuMz0wEo+KqtAMMMIhm38w0CvliMRyc47QLOEtOgdnUZB9wL771OOV2/GSzkpH05Q=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:03.448367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-07b82441-3276-45ca-ae02-927158ecd7c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for project 06942912e37346eaa2310a56b84f3886. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:03.483871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-07b82441-3276-45ca-ae02-927158ecd7c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for user ecf29db866eb43fa954b0d440577f45f and project 06942912e37346eaa2310a56b84f3886. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:03.484474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-31050750-a5d7-4768-8b69-33b8e8086618 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.760958 Sep 01 00:30:03.485612 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 6/15] 10.222.0.25 () {58 vars in 1167 bytes} [Thu Sep 1 00:30:02 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:03.490390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b36915e7-2b10-4aac-bdff-d523b2ca0c80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:03.491229 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b36915e7-2b10-4aac-bdff-d523b2ca0c80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:03.556713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-07b82441-3276-45ca-ae02-927158ecd7c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.951113 Sep 01 00:30:03.557830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 10/16] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Sep 1 00:30:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 959 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 00:30:03.724458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b36915e7-2b10-4aac-bdff-d523b2ca0c80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:03.766258 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b36915e7-2b10-4aac-bdff-d523b2ca0c80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1222 microversion: 2.1 time: 0.278380 Sep 01 00:30:03.768075 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 7/17] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:03 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1222 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:03.774235 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-69bb7afa-0309-4228-b40b-72babaf2ae9b tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4bfca60>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:04.068900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1536821189", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "networks": [{"uuid": "b1171be4-cbc8-4a98-b1ce-71873b834502"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:04.218560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-69bb7afa-0309-4228-b40b-72babaf2ae9b tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.448975 Sep 01 00:30:04.219991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 8/18] 10.222.0.25 () {58 vars in 1170 bytes} [Thu Sep 1 00:30:03 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:04.255550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-402135af-b96b-40d7-a625-bb54954cdbf6 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae43bce50>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:04.302892 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] validate_networks() for [('b1171be4-cbc8-4a98-b1ce-71873b834502', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:30:04.502234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-402135af-b96b-40d7-a625-bb54954cdbf6 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.255115 Sep 01 00:30:04.510055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 9/19] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Sep 1 00:30:04 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:04.521729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1028933366", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:04.697205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] validate_networks() for [('7dac0ef3-49f5-4c90-b2ad-1bb41b9f1f0b', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:30:05.821813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:30:05.823037 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:30:05.823721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:30:05.824337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:30:05.824976 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:30:05.843464 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:05.846574 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:05.848260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:05.850783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:05.856860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:05.857683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:05.913129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:05.922997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for user a6f08eaef2d149a9b0236d4bcbe03a92 and project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:05.953460 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:30:05.961655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:30:06.103783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7ee8e582-3270-4b65-b789-a315333b6bf3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.592476 Sep 01 00:30:06.104435 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 10/20] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:30:04 2022] POST /compute/v2.1/servers => generated 383 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:30:06.143080 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5741b944-2bd7-4c76-a5a6-04f6dfa993a5 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae43bc5e0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:06.451379 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5741b944-2bd7-4c76-a5a6-04f6dfa993a5 tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.342445 Sep 01 00:30:06.452512 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1188 bytes} [Thu Sep 1 00:30:06 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:06.459718 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-096f94ce-a723-4177-a506-9b9bbd699b20 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:06.465486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-096f94ce-a723-4177-a506-9b9bbd699b20 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:06.692918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-096f94ce-a723-4177-a506-9b9bbd699b20 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:06.702631 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-096f94ce-a723-4177-a506-9b9bbd699b20 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1222 microversion: 2.1 time: 0.248795 Sep 01 00:30:06.707456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 12/22] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:06 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1222 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:06.722730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6fe90be1-c79b-4efa-9bf7-a66d8cbde49a tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] Calling method '.version_select at 0x7fcae4bfc790>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:07.122863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6fe90be1-c79b-4efa-9bf7-a66d8cbde49a tempest-VolumesTestJSON-1034206913 tempest-VolumesTestJSON-1034206913-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.413804 Sep 01 00:30:07.123812 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 13/23] 10.222.0.25 () {58 vars in 1155 bytes} [Thu Sep 1 00:30:06 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:07.731172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5b41698c-30df-4087-9f7d-d0c4a22a95aa tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:07.731697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5b41698c-30df-4087-9f7d-d0c4a22a95aa tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:08.291549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:30:08.292567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:30:08.293226 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:30:08.293780 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:30:08.294338 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:30:08.307169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:08.307904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:08.308531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:08.309527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:08.310140 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:08.310889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:08.347517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5b41698c-30df-4087-9f7d-d0c4a22a95aa tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:08.353439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Getting quotas for project eb6a951afecc44219772f82bb09f91e3. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:08.355386 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5b41698c-30df-4087-9f7d-d0c4a22a95aa tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1222 microversion: 2.1 time: 0.628033 Sep 01 00:30:08.355967 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 14/24] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:07 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1222 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:08.381711 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Getting quotas for user 6f67deff06894bffb9ac99680df14b88 and project eb6a951afecc44219772f82bb09f91e3. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:08.420439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:30:08.431281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:30:08.495325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1449537869", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7ae7c87-2d4d-4921-9c18-8673416a29fc"}], "security_groups": [{"name": "tempest-securitygroup--1401849312"}], "key_name": "tempest-keypair-2104154925", "user_data": "}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:08.589569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3ef69a58-7c0e-4749-a3bd-52e022f36030 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.030296 Sep 01 00:30:08.596204 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 11/25] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:30:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 5037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:30:08.614529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b5551adf-1dcd-4544-8d1f-7b70d8b47898 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:08.615198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b5551adf-1dcd-4544-8d1f-7b70d8b47898 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:08.876153 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b5551adf-1dcd-4544-8d1f-7b70d8b47898 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:08.895353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b5551adf-1dcd-4544-8d1f-7b70d8b47898 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1215 microversion: 2.1 time: 0.289967 Sep 01 00:30:08.896266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 12/26] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:08 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1215 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:09.058020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] validate_networks() for [('a7ae7c87-2d4d-4921-9c18-8673416a29fc', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:30:09.376043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:09.376689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:09.393408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:09.400962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:09.401894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:09.402846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:09.403676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:09.404291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:10.462781 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:10.514535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1d22cc85-4da4-465e-8b15-0f0741885b49 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1274 microversion: 2.1 time: 1.140247 Sep 01 00:30:10.518847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:09 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1274 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:10.547755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:10.549231 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:10.573405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:10.573903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:10.582936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:10.584363 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:10.591432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:10.594977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:11.269384 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:11.280471 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2af918d2-1e5b-4f5f-8a23-8cf244e3b8c3 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1211 microversion: 2.1 time: 0.757002 Sep 01 00:30:11.283454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:10 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1211 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:11.541495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:11.542200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:11.557829 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:11.570366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:11.580107 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:11.603005 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:11.603005 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:11.603005 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:11.925555 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:11.933989 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-44b0e787-8f2a-4155-a28e-f4622d501a3f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1280 microversion: 2.1 time: 0.396216 Sep 01 00:30:11.944889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:11 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1280 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:12.305531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:12.306512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:12.319892 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:12.324428 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:12.329372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:12.332164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:12.332896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:12.334379 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:12.792422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:12.801148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e6994891-711c-4cc2-945e-7b5f81a59f60 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1273 microversion: 2.1 time: 0.500302 Sep 01 00:30:12.808854 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:12 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1273 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:12.972213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:12.973022 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:12.986959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:12.990091 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:12.998164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:12.999081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:13.001641 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:13.004886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:13.419460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:13.438785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0a64276e-1b66-49a5-b950-006860479b80 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1280 microversion: 2.1 time: 0.470871 Sep 01 00:30:13.439616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 17/31] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:12 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1280 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:13.473842 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:30:13.474688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:30:13.475656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:30:13.476011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:30:13.476549 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:30:13.506752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:13.507374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:13.509354 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:13.510422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:13.511476 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:13.512367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:13.546111 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for project f1064fc209674020b54fa7526cf22bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:13.553076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for user 5bf265cb4af14e2d8815c42288e2a1f7 and project f1064fc209674020b54fa7526cf22bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:13.572126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:30:13.575423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:30:13.685800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2fd8d1ca-b933-49fe-ab7b-f345c4190934 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 5.204930 Sep 01 00:30:13.689072 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 15/32] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:30:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 5209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:30:13.700127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e117bb46-eb30-486d-aadd-6aaf567928c0 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:13.701300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e117bb46-eb30-486d-aadd-6aaf567928c0 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:13.835344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:13.838502 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:13.853446 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:13.856245 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:13.858262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:13.860965 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:13.861642 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:13.863269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:14.285810 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e117bb46-eb30-486d-aadd-6aaf567928c0 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:14.294000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e117bb46-eb30-486d-aadd-6aaf567928c0 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1238 microversion: 2.1 time: 0.597818 Sep 01 00:30:14.298413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 18/33] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:13 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1238 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:14.461627 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:14.462661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:14.496072 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:14.496774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:14.502682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:14.509760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:14.511484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:14.512017 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:15.082049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:15.103924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-27fa1087-d6c6-4cc7-a202-3c18b957ba62 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1273 microversion: 2.1 time: 1.273939 Sep 01 00:30:15.107453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 16/34] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:13 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1273 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:15.122636 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-465603763", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ec1bdb8-fcb4-45f0-8321-9a6d9446092b"}], "security_groups": [{"name": "tempest-securitygroup--1034602824"}], "key_name": "tempest-keypair-1881809288", "user_data": "}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:15.316290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:15.333334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-17dde52f-b659-482d-9c71-e16e8459fa8e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.872163 Sep 01 00:30:15.342166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 19/35] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:14 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:15.348056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:15.362775 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:15.379492 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:15.380000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:15.380534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:15.387982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:15.393109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:15.395646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:15.621083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] validate_networks() for [('6ec1bdb8-fcb4-45f0-8321-9a6d9446092b', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:30:15.750378 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:15.761104 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cb2db694-de86-4641-ad3d-48118f53fe9e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1290 microversion: 2.1 time: 0.417673 Sep 01 00:30:15.761694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 20/36] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:15 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1290 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:16.125147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:16.126113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:16.138961 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:16.146567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:16.147542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:16.149259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:16.150393 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:16.151042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:17.570806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:17.597747 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5ddac7bc-3a4d-45e4-b65d-064e9bf1b2f7 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 1.476668 Sep 01 00:30:17.598341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 21/37] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:16 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 1478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:17.612793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:17.613419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:17.641937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:17.642965 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:17.643606 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:17.644638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:17.645323 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:17.645981 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:18.330702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:18.719778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:30:18.720321 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:30:18.720827 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:30:18.721474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:30:18.722004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:30:18.746196 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:18.762005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:18.762872 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:18.766469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:18.772541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:18.773540 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:18.832307 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:18.842694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-26f5f4ca-ae70-4ceb-9db8-e4255eef05f2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 1.241618 Sep 01 00:30:18.842694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 22/38] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:17 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:18.858045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:18.860551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:18.879056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:18.881721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for project 06942912e37346eaa2310a56b84f3886. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:18.882279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:18.883340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:18.885294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:18.887242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:18.888887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:18.899723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for user ecf29db866eb43fa954b0d440577f45f and project 06942912e37346eaa2310a56b84f3886. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:18.982283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:30:18.985541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:30:19.120627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ed104e7b-ae66-4964-a27b-91c1420010db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.011711 Sep 01 00:30:19.133008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 17/39] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Sep 1 00:30:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 4025 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 01 00:30:19.146223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:19.147736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:19.165170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:19.171038 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:19.174027 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:19.176658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:19.177472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:19.179889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:19.423468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:19.436183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-059d6d4e-bfab-43c3-8f17-cf199e5c66a5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1296 microversion: 2.1 time: 0.593427 Sep 01 00:30:19.437493 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:18 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1296 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:19.442540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-59d579a1-e7b6-437a-b83c-167aaac45eb4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:19.443578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-59d579a1-e7b6-437a-b83c-167aaac45eb4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:19.787898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-59d579a1-e7b6-437a-b83c-167aaac45eb4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:19.804272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-59d579a1-e7b6-437a-b83c-167aaac45eb4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:19.806470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-59d579a1-e7b6-437a-b83c-167aaac45eb4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:19.807836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-59d579a1-e7b6-437a-b83c-167aaac45eb4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1281 microversion: 2.20 time: 0.369224 Sep 01 00:30:19.809207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 24/41] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:19 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1281 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:20.574454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:20.584139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-49e615b8-809f-4549-ba29-8d39122a099e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 1.449653 Sep 01 00:30:20.592773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 18/42] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:19 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:20.620337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:20.628672 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:20.668318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:20.673956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:20.675377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:20.677015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5dc5608-df5a-4c41-9d46-fd161e18e075", "tag": "1686bbb5-7c47-498b-bb89-88826527d80e"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:20.678339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:20.679342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:20.679809 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:20.725912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:20.730773 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:20.731520 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:20.851337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Creating event network-changed:1686bbb5-7c47-498b-bb89-88826527d80e for instance f5dc5608-df5a-4c41-9d46-fd161e18e075 on hv-cinder-82002 Sep 01 00:30:20.854966 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 00:30:20.856224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a5b1b236-7ef5-42ff-a62e-82459d926570 req-2de292cb-2094-4918-9540-b881f2557c4b service nova] Acquired lock "compute-rpcapi-router" {{(pid=132498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 00:30:20.865719 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:20.875059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:20.878110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:20.880547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:20.883816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:20.885229 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:20.931311 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.compute.rpcapi [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 00:30:20.940959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] Releasing lock "compute-rpcapi-router" {{(pid=132498) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 00:30:20.983105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fbada2f1-d631-4ea8-bc04-a6b3751bac51 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.172367 Sep 01 00:30:20.984456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 25/43] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:20.991369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:20.994313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:21.010092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:21.015817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:21.016641 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:21.017624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:21.018263 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:21.018967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:21.474277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:21.483678 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b5f874f2-4120-422c-a400-78a7dbb53e7f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1296 microversion: 2.1 time: 0.497698 Sep 01 00:30:21.492853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 26/44] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:20 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1296 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:21.508453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:21.509106 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:21.536896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:21.537381 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:21.540249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:21.541654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:21.542640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:21.543389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.001759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:22.031356 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fbe1999e-2c75-48a3-be6b-6a94c55170dd tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 1.423918 Sep 01 00:30:22.032130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 19/45] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:20 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:22.070302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:22.090178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:22.092537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:22.097676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-93674ef5-d590-4471-97ff-a0f026531e61 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1333 microversion: 2.20 time: 0.603608 Sep 01 00:30:22.100274 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 27/46] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:21 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1333 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:22.117691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:22.118874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:22.141889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.142385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.143571 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.144441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.145316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.145907 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.402193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7927467f-419a-4f70-a627-f848aac91723", "tag": "e3a2ca38-adcd-48ab-b08c-8dd6c075e6ed"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:22.443186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.447447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.447990 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.574314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Creating event network-changed:e3a2ca38-adcd-48ab-b08c-8dd6c075e6ed for instance 7927467f-419a-4f70-a627-f848aac91723 on hv-cinder-82002 Sep 01 00:30:22.576877 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Acquiring lock "compute-rpcapi-router" {{(pid=132496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 01 00:30:22.578758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af623595-957b-49ba-8ad4-400d192c717a req-812532d5-c50e-4242-a838-6ac602aa7d1f service nova] Acquired lock "compute-rpcapi-router" {{(pid=132496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 01 00:30:22.588794 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.590904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.592028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.598324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.601265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.602118 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.654208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.compute.rpcapi [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Sep 01 00:30:22.655243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] Releasing lock "compute-rpcapi-router" {{(pid=132496) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 01 00:30:22.702656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9daf02d8-aac3-4dba-8311-f577519b0d70 None None] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.664109 Sep 01 00:30:22.704114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 20/47] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:22.721633 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:22.723458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:22.739303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.741548 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.742459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:22.746358 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:22.748440 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:22.757166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:23.314550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:23.315544 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:23.330254 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0f7296fa-cfd8-4535-8d38-6a4b8786704b tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 1.220733 Sep 01 00:30:23.330569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3d8e81de-811d-4850-b902-5d345f4ac185 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.623874 Sep 01 00:30:23.331377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 21/48] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:22 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:23.331817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 28/49] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:22 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:23.341882 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:23.342573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:23.349987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:23.350709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:23.362760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:23.363696 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:23.364163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:23.365103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:23.365567 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:23.366005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:23.378063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:23.382710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:23.383469 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:23.384221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:23.384718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:23.385171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:23.559294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:23.584113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:23.586082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:23.591533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:23.594182 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3a4d70c5-2907-4428-8188-fd7e623cf10d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1339 microversion: 2.20 time: 0.253565 Sep 01 00:30:23.595217 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 29/50] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:23 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1339 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:23.610073 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9978947e-bfb3-4b27-af0a-7856d25da2ee tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.270150 Sep 01 00:30:23.610073 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 22/51] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:23 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:24.362933 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:24.363497 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:24.364066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:24.366799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:24.381954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.382494 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.382931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.383717 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.384396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.384896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.386399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.387029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.387557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.388581 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.389116 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.389582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.560873 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:24.571696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cfc30303-4a5a-46ee-8339-948333a7a870 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.219232 Sep 01 00:30:24.572684 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 30/52] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:24 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:24.598584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-0cc683a5-d772-4b62-8ed1-65f3ed262ca6 req-cc37e794-1fa8-487c-af63-759573830249 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8ee3b6-8801-4650-8819-1587d9da7d98", "tag": "0c45dd3f-1c4e-4370-83b2-adc0f7df081b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:24.609548 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0cc683a5-d772-4b62-8ed1-65f3ed262ca6 req-cc37e794-1fa8-487c-af63-759573830249 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.610114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0cc683a5-d772-4b62-8ed1-65f3ed262ca6 req-cc37e794-1fa8-487c-af63-759573830249 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.610529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0cc683a5-d772-4b62-8ed1-65f3ed262ca6 req-cc37e794-1fa8-487c-af63-759573830249 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.623098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-0cc683a5-d772-4b62-8ed1-65f3ed262ca6 req-cc37e794-1fa8-487c-af63-759573830249 service nova] Creating event network-changed:0c45dd3f-1c4e-4370-83b2-adc0f7df081b for instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 on hv-cinder-82002 Sep 01 00:30:24.631661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-0cc683a5-d772-4b62-8ed1-65f3ed262ca6 req-cc37e794-1fa8-487c-af63-759573830249 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037364 Sep 01 00:30:24.633112 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 31/53] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:24.641569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:24.642731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:24.649546 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.650236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.650988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.651970 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.652630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.653352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.661391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:24.685873 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:24.697782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e52f60ba-95bc-480a-ad19-72db8026d19c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.347931 Sep 01 00:30:24.700586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 23/54] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:24 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:24.718192 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:24.719648 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:24.728763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.729519 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.730278 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.731546 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.732598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.733971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.742552 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:24.755033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:24.756995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:24.758103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c5f215b1-7e9f-4469-9d4d-09e7fda0a739 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1339 microversion: 2.20 time: 0.123645 Sep 01 00:30:24.759458 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 32/55] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:24 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1339 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:24.768088 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-8d46e2ad-69fc-47f6-844a-bc06e64e810d req-2fb54fdc-09a0-41b6-8a83-9a36e6a2af91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ed053e9-b2ff-4c41-9a71-344e192fc7ca", "tag": "c0bef5bd-eddf-43b5-89d4-58b7f5afc60a"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:24.779090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8d46e2ad-69fc-47f6-844a-bc06e64e810d req-2fb54fdc-09a0-41b6-8a83-9a36e6a2af91 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:24.780367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8d46e2ad-69fc-47f6-844a-bc06e64e810d req-2fb54fdc-09a0-41b6-8a83-9a36e6a2af91 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:24.781617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-8d46e2ad-69fc-47f6-844a-bc06e64e810d req-2fb54fdc-09a0-41b6-8a83-9a36e6a2af91 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:24.799901 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-8d46e2ad-69fc-47f6-844a-bc06e64e810d req-2fb54fdc-09a0-41b6-8a83-9a36e6a2af91 service nova] Creating event network-changed:c0bef5bd-eddf-43b5-89d4-58b7f5afc60a for instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca on hv-cinder-82002 Sep 01 00:30:24.806776 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-8d46e2ad-69fc-47f6-844a-bc06e64e810d req-2fb54fdc-09a0-41b6-8a83-9a36e6a2af91 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045193 Sep 01 00:30:24.810046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 33/56] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:24.915454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:24.924410 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-109a69e4-9308-4b12-8e54-6a8e27e01591 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.221950 Sep 01 00:30:24.925153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 24/57] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:24 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:25.606032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:25.606802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:25.629310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:25.636762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:25.637395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:25.638161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:25.638639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:25.639070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:25.722734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:25.723794 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:25.736542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:25.737135 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:25.737576 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:25.738393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:25.739040 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:25.739689 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:25.957457 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:25.966075 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c0ee120f-e38f-49df-ad15-8b61e9118b04 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.248131 Sep 01 00:30:25.967068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 25/58] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:25 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:25.980784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:25.990206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b2e1ceb8-e543-412b-8008-5f577eac3e3d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.397230 Sep 01 00:30:25.991829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:25.993465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:25.994419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 34/59] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:25 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:26.004688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:26.005327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:26.006958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:26.008482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:26.008995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:26.009425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:26.015336 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:26.015869 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:26.016337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:26.021488 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:26.021905 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:26.022339 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:26.023244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:26.023723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:26.027328 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:26.617070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:26.625296 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:26.631200 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:26.632343 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-39fd7386-6963-45d9-b0eb-9b906f0f1652 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.664218 Sep 01 00:30:26.633050 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 26/60] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:25 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:26.850671 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:26.867506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fb339d26-fbec-4741-9c2b-a1a3b458baec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.871973 Sep 01 00:30:26.868327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 35/61] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:25 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:26.986577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:26.987792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:27.004792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.009703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.010268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.011409 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.012218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.017260 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:27.017865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:27.021266 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.025899 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=67 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:27.026201 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.027131 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.027841 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.028836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.030171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.032184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.301937 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:27.323294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-630d6c44-efc1-4cb6-ae56-387d282bd7b1 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.340592 Sep 01 00:30:27.323884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 27/62] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:26 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:27.661224 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:27.661857 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:27.676664 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.677244 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.679374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.680247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.682897 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.683450 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.807979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:27.816143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-99ae52d7-aec4-462e-a135-a01b04750d10 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.802729 Sep 01 00:30:27.816740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 36/63] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:27 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:27.866772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:27.882417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:27.887256 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:27.893816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:27.894703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:27.904953 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5dfda2da-61e5-4be2-8f44-0f2630deff21 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.246191 Sep 01 00:30:27.908340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 28/64] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:27 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:27.923554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.925445 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.926148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:27.927931 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:27.928736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:27.929385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:28.357989 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:28.359721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:28.374790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:28.375198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:28.375627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:28.377703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:28.377703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:28.377703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:28.613447 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:28.635009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4b84a3e8-8129-45c0-a3cd-d7fc0c9cca9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.745259 Sep 01 00:30:28.637333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 37/65] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:27 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:28.755491 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:28.783826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cb4d2b3b-c23a-4d62-a99c-d70d981cab20 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.441530 Sep 01 00:30:28.784428 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 29/66] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:28 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:28.859195 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:28.860181 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:28.867179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:28.904225 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:28.911165 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:28.912340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:28.915506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:28.916699 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:28.918505 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:28.940920 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:28.942535 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:28.945369 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=30 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:28.973969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:28.974485 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:28.975276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:28.975999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:28.976448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:28.980008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:29.200739 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:29.212459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:29.214364 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:29.216131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5aacdf0a-a0f7-481a-a55e-1a6e8ee57226 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.281029 Sep 01 00:30:29.229531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 30/67] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:28 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:30:29.246102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-666945be-b6ae-4a2c-b946-7055dda90d5f req-5cd51fb0-768f-4876-9112-80fc6a08a684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:29.258044 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-666945be-b6ae-4a2c-b946-7055dda90d5f req-5cd51fb0-768f-4876-9112-80fc6a08a684 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:29.259390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-666945be-b6ae-4a2c-b946-7055dda90d5f req-5cd51fb0-768f-4876-9112-80fc6a08a684 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:29.260030 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-666945be-b6ae-4a2c-b946-7055dda90d5f req-5cd51fb0-768f-4876-9112-80fc6a08a684 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:29.281739 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-666945be-b6ae-4a2c-b946-7055dda90d5f req-5cd51fb0-768f-4876-9112-80fc6a08a684 service nova] Creating event network-changed:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:30:29.290714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-666945be-b6ae-4a2c-b946-7055dda90d5f req-5cd51fb0-768f-4876-9112-80fc6a08a684 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059463 Sep 01 00:30:29.292388 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 31/68] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:29.443287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:29.451281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d95cc1fe-2464-4a88-8ca3-ae263aecfe1a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.605660 Sep 01 00:30:29.451886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 38/69] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:28 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:29.659551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:29.661271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:29.677855 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:29.679021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:29.680665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:29.682995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:29.684475 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:29.684946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:29.806959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:29.807825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:29.810098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=20 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:29.826391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:29.827244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:29.828738 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:29.829632 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:29.830531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:29.831166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:30.129553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:30.138198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a8aa179c-af9c-4fa9-8e5c-d2bc2637f238 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.483393 Sep 01 00:30:30.138962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 32/70] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:29 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:30.329771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-80e234cb-0183-4aaf-974e-d283792a28c9 req-421a0d37-9de4-4d11-ab20-a68be3f5f305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dc5608-df5a-4c41-9d46-fd161e18e075", "name": "network-vif-plugged", "status": "completed", "tag": "1686bbb5-7c47-498b-bb89-88826527d80e"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:30.341622 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-80e234cb-0183-4aaf-974e-d283792a28c9 req-421a0d37-9de4-4d11-ab20-a68be3f5f305 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:30.342163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-80e234cb-0183-4aaf-974e-d283792a28c9 req-421a0d37-9de4-4d11-ab20-a68be3f5f305 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:30.343443 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-80e234cb-0183-4aaf-974e-d283792a28c9 req-421a0d37-9de4-4d11-ab20-a68be3f5f305 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:30.367180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-80e234cb-0183-4aaf-974e-d283792a28c9 req-421a0d37-9de4-4d11-ab20-a68be3f5f305 service nova] Creating event network-vif-plugged:1686bbb5-7c47-498b-bb89-88826527d80e for instance f5dc5608-df5a-4c41-9d46-fd161e18e075 on hv-cinder-82002 Sep 01 00:30:30.376460 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-80e234cb-0183-4aaf-974e-d283792a28c9 req-421a0d37-9de4-4d11-ab20-a68be3f5f305 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.235810 Sep 01 00:30:30.381441 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 33/71] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:30.388925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:30.389763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:30.397898 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:30.398467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:30.398969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:30.399732 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:30.400838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:30.401450 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:30.523401 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:30.533019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e24f4468-7920-4a7e-bfa7-92bcf0ae4f7a tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.730043 Sep 01 00:30:30.536208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 39/72] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:29 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:30.548768 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:30.549891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:30.557566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:30.558063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:30.570698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:30.571802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:30.573957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:30.574891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:30.784876 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:30.793962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:30.795660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:30.797856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-90786ed4-e6a3-40e6-a6e6-1f6d9a1aa6be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.414487 Sep 01 00:30:30.798652 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 34/73] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:30 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:30.921771 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:30.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:31.008384 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ce34b211-d0bf-4799-9094-6f54abc85ad6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.463967 Sep 01 00:30:31.009288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 40/74] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:30 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:31.161119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:31.162116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:31.169612 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:31.171431 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:31.172270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:31.174123 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:31.174743 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:31.175427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:31.558783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:31.559407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:31.577957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:31.579117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:31.579726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:31.580637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:31.581224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:31.582487 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:31.633414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:31.649006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3debd7b5-0636-4e9a-bc23-7aae7dc4a152 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.492682 Sep 01 00:30:31.649724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 35/75] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:31 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:31.781456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:31.791525 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-584e5d28-5899-48cd-a30e-37364705227e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.238127 Sep 01 00:30:31.796586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 41/76] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:31 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:31.825076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:31.827811 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:31.835980 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:31.836521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:31.837207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:31.837859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:31.838306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:31.838879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.018124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:32.032448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:32.033206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:32.044609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.045108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.047859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:32.048320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.049410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.051380 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:32.052726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0ccd8ee2-d543-4f3d-82e2-d324d4e60055 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.235116 Sep 01 00:30:32.053293 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 36/77] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:31 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:32.053896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.054330 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.233778 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:32.248275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-864e666a-6516-4fb8-aa74-f009cb60bf44 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.218665 Sep 01 00:30:32.265191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 42/78] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:32 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:32.397007 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-4f324e36-6184-4950-a4fd-44e2029242c0 req-1a858804-1de7-453d-903c-55e1ef49f90e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7927467f-419a-4f70-a627-f848aac91723", "name": "network-vif-plugged", "status": "completed", "tag": "e3a2ca38-adcd-48ab-b08c-8dd6c075e6ed"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:32.409639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-4f324e36-6184-4950-a4fd-44e2029242c0 req-1a858804-1de7-453d-903c-55e1ef49f90e service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.410418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-4f324e36-6184-4950-a4fd-44e2029242c0 req-1a858804-1de7-453d-903c-55e1ef49f90e service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.411112 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-4f324e36-6184-4950-a4fd-44e2029242c0 req-1a858804-1de7-453d-903c-55e1ef49f90e service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.424333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-4f324e36-6184-4950-a4fd-44e2029242c0 req-1a858804-1de7-453d-903c-55e1ef49f90e service nova] Creating event network-vif-plugged:e3a2ca38-adcd-48ab-b08c-8dd6c075e6ed for instance 7927467f-419a-4f70-a627-f848aac91723 on hv-cinder-82002 Sep 01 00:30:32.430072 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-4f324e36-6184-4950-a4fd-44e2029242c0 req-1a858804-1de7-453d-903c-55e1ef49f90e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037553 Sep 01 00:30:32.430669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 37/79] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:32.672783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:32.674220 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:32.682612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.683223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.683709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.684536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.685116 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.685813 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.810291 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=10 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:32.817205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:32.818823 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:32.844518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.845316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.846018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:32.846738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:32.847193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:32.847613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:33.035121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:33.045220 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f7a2d6d0-02ba-4f67-8c9d-316e587a2131 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.378167 Sep 01 00:30:33.047598 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 43/80] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:32 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:33.075939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:33.076574 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:33.084482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:33.085042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:33.085474 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:33.086179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:33.086624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:33.093630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:33.095191 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:33.115032 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4ed7c467-de33-47ac-9e4b-7ebae5c85cb4 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.305236 Sep 01 00:30:33.116853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 38/81] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:32 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:33.275015 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:33.275872 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:33.286600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:33.287433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:33.288074 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:33.289483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:33.290767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:33.291515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:33.293036 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:33.303317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:33.305039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:33.307974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5a2c44b3-a5c2-4761-b4bb-3e0614bdfa0b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.235133 Sep 01 00:30:33.309207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 44/82] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:33 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:30:33.558850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:33.567876 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2e49f1ce-5ca2-48dc-ac75-5d836f7b0342 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.299762 Sep 01 00:30:33.568984 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 39/83] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:33 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:34.067579 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:34.068332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:34.074506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.074978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.075759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.076443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.077163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.077699 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.139017 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:34.139732 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:34.146606 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.161173 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.161707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.162453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.162911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.163506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.293867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:34.308792 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2e032045-3dd1-4d99-95b1-1338cdd061b1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1322 microversion: 2.1 time: 0.245015 Sep 01 00:30:34.309979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 45/84] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:34 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:34.334628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:34.335589 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:34.342644 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.343321 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.344278 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.345122 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.345639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.346137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.346678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:34.354760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c1080ca8-2524-40e4-bd73-1fbcd332107e tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.220177 Sep 01 00:30:34.369049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 40/85] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:34 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:34.449270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ee3b6-8801-4650-8819-1587d9da7d98", "name": "network-vif-plugged", "status": "completed", "tag": "0c45dd3f-1c4e-4370-83b2-adc0f7df081b"}, {"server_uuid": "3ed053e9-b2ff-4c41-9a71-344e192fc7ca", "name": "network-vif-plugged", "status": "completed", "tag": "c0bef5bd-eddf-43b5-89d4-58b7f5afc60a"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:34.465358 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.466546 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.467300 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.489203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] Creating event network-vif-plugged:0c45dd3f-1c4e-4370-83b2-adc0f7df081b for instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 on hv-cinder-82002 Sep 01 00:30:34.490305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:34.490653 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] Creating event network-vif-plugged:c0bef5bd-eddf-43b5-89d4-58b7f5afc60a for instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca on hv-cinder-82002 Sep 01 00:30:34.505150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-c5300496-05a9-4bcd-a9bf-517b0b6ad273 req-58c3dcd3-0c24-4ec0-8e7f-39e6e97185cb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.062101 Sep 01 00:30:34.507768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 41/86] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:30:34.508354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:34.518698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:34.521527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d87ebdaa-71fc-404b-ac15-349de5971ef6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.189860 Sep 01 00:30:34.525830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 46/87] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:34 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:30:34.596963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:34.597656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:34.614898 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.615393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.615849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.616575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:34.617025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:34.617444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:34.766974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:34.775125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4c7d83ad-ee61-4d5d-bd90-1461b80a8982 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.184963 Sep 01 00:30:34.788521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 42/88] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:34 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:35.331629 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:35.333244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:35.343495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.345935 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.348224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.349291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.349997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.352479 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.378533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:35.379150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:35.391081 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.393166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.393719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.403433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.403433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.403433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.552751 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:35.562196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-36fc55d4-d495-4426-abed-26fc26e702b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1515 microversion: 2.1 time: 0.235276 Sep 01 00:30:35.562979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 47/89] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:35 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1515 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:35.575578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:35.580078 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:35.595593 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.596594 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.597697 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.599997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.601209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.602408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:35.603027 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.614072 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c3f231a9-70d9-4dbc-97d6-12db47bc5018 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.240239 Sep 01 00:30:35.625456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 43/90] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:35 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:35.636326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:35.644007 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:35.665700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.668758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.669214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.671939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.672389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.672866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.793426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'flavor' on Instance uuid 7927467f-419a-4f70-a627-f848aac91723 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:30:35.854582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:35.869335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:35.870989 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:35.872688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-07d8ad7b-dbbf-4e60-a21c-f8111bd0d52a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.308432 Sep 01 00:30:35.874537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 48/91] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:35 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:35.879871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:35.880745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:35.887996 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.888821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.890046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.891052 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.891581 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.892082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.935328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:35.937815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:35.973871 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8193bf9f-0777-445d-87c6-7b79cfb26ea8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723/action" status: 200 len: 32 microversion: 2.1 time: 0.342126 Sep 01 00:30:35.974892 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 44/92] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:30:35 2022] POST /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723/action => generated 32 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:30:35.984905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:35.985792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:35.994958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.995607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:35.996181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:35.997977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:35.999670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:36.000408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:36.150058 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:36.160273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fb464386-4e59-43b6-9c65-c0e22e9336cd tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1364 microversion: 2.1 time: 0.284198 Sep 01 00:30:36.182736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 49/93] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:35 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1364 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:36.223170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:36.233066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-937a6e8e-0d03-4ad1-a4db-b1da9deaf036 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.252455 Sep 01 00:30:36.247414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 45/94] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:35 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:36.634397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:36.635010 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:36.643462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:36.644144 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:36.644612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:36.646516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:36.647005 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:36.647448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:36.828206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:36.836902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-71085e84-8d8f-468b-abc9-6b28dbd77406 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1315 microversion: 2.1 time: 0.206183 Sep 01 00:30:36.837478 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 50/95] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:36 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:36.897505 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:36.898280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:36.905816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:36.906414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:36.906845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:36.907531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:36.907972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:36.908385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.041798 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:37.050352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:37.051780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:37.052910 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-35d3697a-d8d1-48cf-8ddd-9e9c477da90f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.159272 Sep 01 00:30:37.053490 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 46/96] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:36 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:30:37.181227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:37.181838 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:37.188934 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.189416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.189908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.190604 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.191046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.191463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.255770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:37.256411 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:37.262942 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.263438 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.263875 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.265104 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.266054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.267570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.467067 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:37.477863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-582abce6-36d2-43fe-8333-16f8e5ba250f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1551 microversion: 2.1 time: 0.300070 Sep 01 00:30:37.492540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 51/97] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:37 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1551 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:37.503443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:37.503939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:37.518052 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.518621 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.519182 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.520317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.520940 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.521477 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.522396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:37.532901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bd562074-db21-4872-94ca-71ed20ad3194 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.281106 Sep 01 00:30:37.546870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 47/98] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:37 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:37.567625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-f8e39514-e714-4377-832a-2dc2a06760bc req-e500787f-82b7-4981-a371-3071462080d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "name": "network-vif-plugged", "status": "completed", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:37.582219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f8e39514-e714-4377-832a-2dc2a06760bc req-e500787f-82b7-4981-a371-3071462080d3 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.585511 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f8e39514-e714-4377-832a-2dc2a06760bc req-e500787f-82b7-4981-a371-3071462080d3 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.588052 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f8e39514-e714-4377-832a-2dc2a06760bc req-e500787f-82b7-4981-a371-3071462080d3 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.620121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-f8e39514-e714-4377-832a-2dc2a06760bc req-e500787f-82b7-4981-a371-3071462080d3 service nova] Creating event network-vif-plugged:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:30:37.633996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-f8e39514-e714-4377-832a-2dc2a06760bc req-e500787f-82b7-4981-a371-3071462080d3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070336 Sep 01 00:30:37.638307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 48/99] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:37.702597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-795d72fe-32bf-40c2-b173-b52023f6e827 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.203929 Sep 01 00:30:37.710810 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 52/100] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:30:37 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-interface => generated 285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:37.859166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:37.860175 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:37.870590 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.871324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.871911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:37.872832 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:37.873436 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:37.874236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:38.083111 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:38.084079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:38.093111 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:38.094878 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:38.095748 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:38.096661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:38.097290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:38.097882 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:38.151299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:38.160451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-90bbad67-3c7e-4fad-854e-bcf4b49c2068 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1501 microversion: 2.1 time: 0.305835 Sep 01 00:30:38.165131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 49/101] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:37 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1501 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:38.557727 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:38.558829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:38.565991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:38.566482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:38.572551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:38.573349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:38.575014 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:38.575567 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:38.756345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:38.770877 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c4c15ffb-b6a2-4398-ac2a-ce85676ab625 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.217228 Sep 01 00:30:38.786079 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 50/102] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:38 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:38.883949 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:38.894790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:38.896586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:38.897810 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a6c76b6f-9fd9-449d-b967-acfb58703669 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.824582 Sep 01 00:30:38.898391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 53/103] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:38 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:39.487285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-97bf39ae-3d57-4d49-80ac-17e876798bcd req-60cfcac9-b715-463c-8d2b-d96d9ccddce4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f8ee3b6-8801-4650-8819-1587d9da7d98", "tag": "0c45dd3f-1c4e-4370-83b2-adc0f7df081b"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:39.496538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-97bf39ae-3d57-4d49-80ac-17e876798bcd req-60cfcac9-b715-463c-8d2b-d96d9ccddce4 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:39.497018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-97bf39ae-3d57-4d49-80ac-17e876798bcd req-60cfcac9-b715-463c-8d2b-d96d9ccddce4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:39.497450 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-97bf39ae-3d57-4d49-80ac-17e876798bcd req-60cfcac9-b715-463c-8d2b-d96d9ccddce4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:39.509576 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-97bf39ae-3d57-4d49-80ac-17e876798bcd req-60cfcac9-b715-463c-8d2b-d96d9ccddce4 service nova] Creating event network-changed:0c45dd3f-1c4e-4370-83b2-adc0f7df081b for instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 on hv-cinder-82002 Sep 01 00:30:39.515121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-97bf39ae-3d57-4d49-80ac-17e876798bcd req-60cfcac9-b715-463c-8d2b-d96d9ccddce4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032127 Sep 01 00:30:39.515734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 51/104] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:39.796026 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:39.796990 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:39.803114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:39.803722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:39.804158 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:39.804890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:39.805348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:39.805766 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:39.922779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:39.924280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:39.930980 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:39.931750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:39.932407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:39.933342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:39.933986 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:39.934602 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:39.938357 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:39.948289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4950cc4a-7ef4-442b-ba23-5b8b63e7fd6a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.156868 Sep 01 00:30:39.949460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 54/105] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:39 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:40.093873 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:40.104328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:40.106066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:40.107453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c46b8ef5-88c9-4cb5-ae97-1e8f3c3b5350 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.189060 Sep 01 00:30:40.108152 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 52/106] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:39 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:40.971399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:40.971945 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:40.977965 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:40.978504 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:40.978935 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:40.979692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:40.980182 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:40.980607 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:41.117840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:41.128155 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c9d584fe-094e-4284-8bf1-8b4ef4102128 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.161123 Sep 01 00:30:41.128941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 55/107] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:40 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:41.150023 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:41.150698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:41.156933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:41.157421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:41.157903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:41.158689 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:41.159115 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:41.159539 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:41.308611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:41.319183 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:41.321079 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:41.322368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1f15497e-c46d-48db-bf1e-5b29b916267d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.195496 Sep 01 00:30:41.323515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 53/108] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:41 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:41.789105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "920907bd-7b9b-4608-a839-53e54b44b033"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:41.791479 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:41.797960 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:41.798437 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:41.798869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:41.799547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:41.799993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:41.800407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:42.161511 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:42.164726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:42.171303 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-40679e30-d0a8-42ed-bd42-7385cab22740 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "POST /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385670 Sep 01 00:30:42.173766 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 56/109] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:30:41 2022] POST /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca/os-volume_attachments => generated 194 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:42.193915 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:42.197464 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:42.197947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:42.198672 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:42.200106 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:42.200591 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:42.347848 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:42.348560 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:42.355943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:42.356679 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:42.358243 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:42.359485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:42.360313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:42.360988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:42.364421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:42.375544 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5763944c-d74b-4f7c-8096-ffd3d57b812f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.223976 Sep 01 00:30:42.388532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 54/110] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:42 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:42.532613 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:42.541003 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:42.542549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:42.543759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-959781c5-01b3-4d8e-aff4-df1a3f90a634 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1407 microversion: 2.20 time: 0.200882 Sep 01 00:30:42.544461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 57/111] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:42 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:43.401843 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:43.402764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:43.409163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:43.409758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:43.410340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:43.411304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:43.411797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:43.412286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:43.570649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:43.572015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:43.584368 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:43.584971 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:43.585616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:43.586524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:43.587197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:43.587869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:43.770204 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:43.778979 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e07513b6-1679-4384-86fe-c058e4c016f3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.380757 Sep 01 00:30:43.779599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 55/112] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:43 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:43.789302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:43.799413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:43.801273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:43.802608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6858ce9f-da6d-422a-b82d-e963a7de9510 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1599 microversion: 2.20 time: 0.238551 Sep 01 00:30:43.803127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 58/113] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:30:43 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1599 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:30:43.825822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:43.827203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:43.834135 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:43.834692 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:43.835568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:43.836274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:43.836750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:43.837487 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:43.928676 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3aae97d5-d16a-42aa-8ea3-491dd283ba97 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106569 Sep 01 00:30:43.929852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 56/114] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Sep 1 00:30:43 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:30:44.800489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:44.801805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:44.807967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:44.809170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:44.809690 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:44.812216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:44.813188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:44.814455 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:45.281719 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:45.294207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8498f346-fc1f-4976-8438-f936f8fc1fe0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.498795 Sep 01 00:30:45.294808 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 59/115] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:44 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:45.534099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-9bb8c2e1-3707-4bbf-a7e4-4e564d4d6cfd req-cf9b2a8c-2b12-4906-81af-2188dd2850aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:45.567055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9bb8c2e1-3707-4bbf-a7e4-4e564d4d6cfd req-cf9b2a8c-2b12-4906-81af-2188dd2850aa service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:45.568728 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9bb8c2e1-3707-4bbf-a7e4-4e564d4d6cfd req-cf9b2a8c-2b12-4906-81af-2188dd2850aa service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:45.572242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9bb8c2e1-3707-4bbf-a7e4-4e564d4d6cfd req-cf9b2a8c-2b12-4906-81af-2188dd2850aa service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:45.614724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-9bb8c2e1-3707-4bbf-a7e4-4e564d4d6cfd req-cf9b2a8c-2b12-4906-81af-2188dd2850aa service nova] Creating event network-changed:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:30:45.629084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-9bb8c2e1-3707-4bbf-a7e4-4e564d4d6cfd req-cf9b2a8c-2b12-4906-81af-2188dd2850aa service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113873 Sep 01 00:30:45.630657 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 57/116] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:46.322034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:46.328561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:46.340458 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:46.342855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:46.344141 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:46.345541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:46.346150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:46.347014 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:46.640941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:46.650671 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0f04518d-07a4-41c9-89e7-a00279b91038 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.335812 Sep 01 00:30:46.651334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 60/117] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:46 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:47.674663 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:47.675422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:47.682152 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:47.682906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:47.683104 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:47.684223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:47.684945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:47.686207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:47.852888 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:47.863669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a4c0a563-c854-44fc-a734-007cd9b092e3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.195913 Sep 01 00:30:47.864708 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 58/118] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:47 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:48.885035 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:48.885641 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:48.905739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:48.906313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:48.906765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:48.907503 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:48.907959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:48.911360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:49.098337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:49.108446 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a9716634-a158-48dc-819e-d3eba3f21a4a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.226983 Sep 01 00:30:49.109054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:48 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:50.132033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:50.132748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:50.148937 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:50.149444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:50.149934 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:50.151105 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:50.153599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:50.155344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:50.365844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:50.375487 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-de8f2345-f00d-4bd4-98cb-97d6e809a290 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.247382 Sep 01 00:30:50.376368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 59/120] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:50 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:51.114111 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:51.115166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:51.123344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:51.123850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:51.124281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:51.125052 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:51.125515 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:51.125936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:51.153785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:30:51.266434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d67e1ca2-1aa2-4969-86f3-64ee797d3473 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 204 len: 0 microversion: 2.1 time: 0.155698 Sep 01 00:30:51.267143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 62/121] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:30:51 2022] DELETE /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 00:30:51.287993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:51.295857 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:51.308637 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:51.309707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:51.310397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:51.314790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:51.314790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:51.314790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:51.396989 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:51.397831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:51.404722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:51.405528 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:51.406176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:51.406946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:51.407605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:51.408129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:51.427350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:51.501437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:51.516408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-31f19fbe-fd75-4474-9492-e77b655dfa64 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1553 microversion: 2.1 time: 0.244453 Sep 01 00:30:51.517136 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 60/122] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:51 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1553 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:51.587260 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:51.599246 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cc6c9215-e469-4103-889c-a160b1480348 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.206531 Sep 01 00:30:51.600088 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 63/123] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:51 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:52.541955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:52.542628 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:52.565058 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:52.565734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:52.566324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:52.567208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:52.568121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:52.568987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:52.626542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:52.627474 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:52.642882 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:52.657435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:52.659044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:52.663920 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:52.666442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:52.666928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:52.790093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:52.802476 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d687b0c1-526a-486b-bf82-daeaffca7b97 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1553 microversion: 2.1 time: 0.263242 Sep 01 00:30:52.802476 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 61/124] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:52 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1553 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:52.875375 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:52.887124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8ddd8d42-df01-481e-ad83-dd761bc204d9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.267212 Sep 01 00:30:52.899602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 64/125] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:52 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:53.826720 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:53.827276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:53.834169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:53.834894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:53.835490 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:53.836203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:53.836845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:53.837421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:53.920952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:53.922533 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:53.931486 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:53.932703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:53.933554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:53.934483 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:53.936917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:53.937553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:54.073982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:54.083123 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-dfd74d87-3b4b-46bf-aab5-5308527dd943 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1553 microversion: 2.1 time: 0.260566 Sep 01 00:30:54.099844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 62/126] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:53 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1553 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:54.252853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:54.263084 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f85482ce-b73b-4aee-8dd4-a475fa758254 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.355707 Sep 01 00:30:54.264596 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 65/127] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:53 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:54.537009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1873176501", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "networks": [{"uuid": "02802a57-7829-47a2-bef9-81183594c96f"}]}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:54.607812 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] validate_networks() for [('02802a57-7829-47a2-bef9-81183594c96f', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:30:54.640377 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-90e15256-9058-46c0-92c7-c18ce75e7be9 req-5b5284c3-fda3-4e36-950b-a91eecadedf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ed053e9-b2ff-4c41-9a71-344e192fc7ca", "name": "network-vif-deleted", "tag": "c0bef5bd-eddf-43b5-89d4-58b7f5afc60a"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:54.650501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-90e15256-9058-46c0-92c7-c18ce75e7be9 req-5b5284c3-fda3-4e36-950b-a91eecadedf2 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:54.651277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-90e15256-9058-46c0-92c7-c18ce75e7be9 req-5b5284c3-fda3-4e36-950b-a91eecadedf2 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:54.652185 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-90e15256-9058-46c0-92c7-c18ce75e7be9 req-5b5284c3-fda3-4e36-950b-a91eecadedf2 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:54.664801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-90e15256-9058-46c0-92c7-c18ce75e7be9 req-5b5284c3-fda3-4e36-950b-a91eecadedf2 service nova] Creating event network-vif-deleted:c0bef5bd-eddf-43b5-89d4-58b7f5afc60a for instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca on hv-cinder-82002 Sep 01 00:30:54.671213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-90e15256-9058-46c0-92c7-c18ce75e7be9 req-5b5284c3-fda3-4e36-950b-a91eecadedf2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037240 Sep 01 00:30:54.676059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 66/128] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:55.097010 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:30:55.098572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:30:55.100479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:30:55.100479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:30:55.100479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:30:55.108609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:55.110209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:55.114639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.115184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.115623 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.119469 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.120530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.121157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.122196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.123281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.123894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.128880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.131252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.131824 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.159808 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.160006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Getting quotas for project 32e68213ef7041a79aaaf1d255d2395e. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:30:55.160293 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.161240 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.162062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lazy-loading 'fault' on Instance uuid 3ed053e9-b2ff-4c41-9a71-344e192fc7ca {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:30:55.169161 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Getting quotas for user b86acd50276842a3bc18e3ffa00e515a and project 32e68213ef7041a79aaaf1d255d2395e. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:30:55.181625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:30:55.183924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:30:55.212483 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:55.239139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cde96540-ed7f-4999-9793-f5afb13f1c74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.707941 Sep 01 00:30:55.243575 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-61ff9cea-df61-411f-adcd-4284f13b392f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1351 microversion: 2.1 time: 0.141073 Sep 01 00:30:55.246353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 63/129] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:30:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:30:55.251867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f43e21bf-315d-4a2c-838d-de79fc6f5d1a tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:55.252868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f43e21bf-315d-4a2c-838d-de79fc6f5d1a tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:55.263685 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 67/130] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:55 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:55.284268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:55.289658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:55.301001 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.301847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.302293 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.303010 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:55.304015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:55.304461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:55.322568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f43e21bf-315d-4a2c-838d-de79fc6f5d1a tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:55.332859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f43e21bf-315d-4a2c-838d-de79fc6f5d1a tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1214 microversion: 2.1 time: 0.085072 Sep 01 00:30:55.333678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 64/131] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:55 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1214 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:55.497308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:55.515865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-260a4f56-bfb6-46bf-a6cc-e0e913ba791b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.234719 Sep 01 00:30:55.516806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 68/132] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:55 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:30:56.271136 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:56.271904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:56.273745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:56.279645 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.280202 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.280646 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.281357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.281825 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.282232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.286836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:56.315299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.315890 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.316409 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.316949 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lazy-loading 'fault' on Instance uuid 3ed053e9-b2ff-4c41-9a71-344e192fc7ca {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:30:56.354913 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:56.356525 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:56.363922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f67deff06894bffb9ac99680df14b88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb6a951afecc44219772f82bb09f91e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:56.366353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.366851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.369222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.370742 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.372206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.373728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.374999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b0ace120-bdc8-4434-83fa-74152109a16f tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 200 len: 1305 microversion: 2.1 time: 0.107993 Sep 01 00:30:56.375588 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 65/133] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:56 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:56.438617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:56.447809 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c0b361ca-8a08-4337-9747-4b7bbf1855e4 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1266 microversion: 2.1 time: 0.098150 Sep 01 00:30:56.448526 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 69/134] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:56 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:56.538519 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:56.539124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:56.545505 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.545981 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.546407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.547082 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:56.547521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:56.547935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:56.687239 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:56.694861 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1cc3f44e-cd69-4ab9-9ac2-072b7cce68a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.160073 Sep 01 00:30:56.695421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 66/135] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:56 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:57.396080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:57.397415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:57.403216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.405197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.405832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.406554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.407039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.407638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.422795 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] HTTP exception thrown: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Request method failure captured: Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca HTTP/1.1 Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0KhNNvCDq_8fuLUPLoHV1AymGtr-uoaVfAIACP3AN2YC2pC_p1XkH_NEoGKebNhovjISrIcp77b9BQj-mv83RYIWUlLYLTwGnbEaA8WEIx1cf13abrVmkLGPodk8GPihUSsvSLKS9Xw1UBlplgjSHtgg2z6ci7tuXivJxNCY9Jlzw Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:30:57.427620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}] Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 6f67deff06894bffb9ac99680df14b88 Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.428936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '3ed053e9-b2ff-4c41-9a71-344e192fc7ca'} Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:30:57.429710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.434824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.436042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Returning 404 to user: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:30:57.436042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7cde80bf-1945-4cb4-8006-b11a12a6364c tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 404 len: 111 microversion: 2.1 time: 0.037037 Sep 01 00:30:57.436042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 70/136] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:57 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:30:57.471178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:57.473452 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:57.482031 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.483900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.485445 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.486654 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.486995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.487470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.608448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:57.616885 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ca1c9d09-9e6c-43ac-8286-d9a1c1dfc2a9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1272 microversion: 2.1 time: 0.150628 Sep 01 00:30:57.618116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 67/137] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:57 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1272 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:57.663335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:57.665928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:57.673736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.674553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.675161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.676055 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.676607 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.677208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.691888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] HTTP exception thrown: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Request method failure captured: Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca/os-volume_attachments HTTP/1.1 Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0KhNNvCDq_8fuLUPLoHV1AymGtr-uoaVfAIACP3AN2YC2pC_p1XkH_NEoGKebNhovjISrIcp77b9BQj-mv83RYIWUlLYLTwGnbEaA8WEIx1cf13abrVmkLGPodk8GPihUSsvSLKS9Xw1UBlplgjSHtgg2z6ci7tuXivJxNCY9Jlzw Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:30:57.693806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}] Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 6f67deff06894bffb9ac99680df14b88 Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.695015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'server_id': '3ed053e9-b2ff-4c41-9a71-344e192fc7ca'} Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:30:57.695662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:57.696715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:30:57.699641 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Returning 404 to user: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:30:57.700988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4db4468c-0f8e-4af6-8f99-db73b2724826 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041399 Sep 01 00:30:57.701863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 71/138] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:30:57 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:30:57.715476 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:57.716121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:57.724833 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.725315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.735252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.737593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:57.738146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:57.745376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:57.962403 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:57.974702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e6d288b0-7071-437c-bfd1-76db8c746cc5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.262511 Sep 01 00:30:57.975341 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 68/139] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:57 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:58.639977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:58.640892 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:58.652052 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:58.652559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:58.653200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:58.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:58.654428 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:58.654851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:58.695529 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-008aaa12-ef81-4bc8-b15b-d5d8dc443446 req-664d14b2-99d5-4fd9-a5e0-e0dd29a155cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "867565ea-56a1-4b0e-b460-aaf5cf1d5ab9", "tag": "f8a5a111-5501-4201-b519-ba90695b7bc1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:30:58.713242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-008aaa12-ef81-4bc8-b15b-d5d8dc443446 req-664d14b2-99d5-4fd9-a5e0-e0dd29a155cf service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:58.714027 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-008aaa12-ef81-4bc8-b15b-d5d8dc443446 req-664d14b2-99d5-4fd9-a5e0-e0dd29a155cf service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:58.714849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-008aaa12-ef81-4bc8-b15b-d5d8dc443446 req-664d14b2-99d5-4fd9-a5e0-e0dd29a155cf service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:58.737895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-008aaa12-ef81-4bc8-b15b-d5d8dc443446 req-664d14b2-99d5-4fd9-a5e0-e0dd29a155cf service nova] Creating event network-changed:f8a5a111-5501-4201-b519-ba90695b7bc1 for instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 on hv-cinder-82002 Sep 01 00:30:58.742886 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-008aaa12-ef81-4bc8-b15b-d5d8dc443446 req-664d14b2-99d5-4fd9-a5e0-e0dd29a155cf service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052126 Sep 01 00:30:58.744110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 69/140] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:30:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:30:58.988252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:58.988956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:58.991647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:58.998223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:58.999006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:58.999961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:59.001012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:59.001689 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:59.002813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:59.018561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a799b17f-96e6-4ea2-8271-e1e0c076aa45 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.383111 Sep 01 00:30:59.023413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 72/141] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:58 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:30:59.037240 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] HTTP exception thrown: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.038298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:59.038914 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Request method failure captured: Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca HTTP/1.1 Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0KhNNvCDq_8fuLUPLoHV1AymGtr-uoaVfAIACP3AN2YC2pC_p1XkH_NEoGKebNhovjISrIcp77b9BQj-mv83RYIWUlLYLTwGnbEaA8WEIx1cf13abrVmkLGPodk8GPihUSsvSLKS9Xw1UBlplgjSHtgg2z6ci7tuXivJxNCY9Jlzw Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:30:59.043405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}] Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 6f67deff06894bffb9ac99680df14b88 Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.044800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '3ed053e9-b2ff-4c41-9a71-344e192fc7ca'} Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:30:59.045607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.046771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.047982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:30:59.048864 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Returning 404 to user: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:30:59.049737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e3837a98-c2ed-4809-b96a-aa5f4b8a0951 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "DELETE /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 404 len: 111 microversion: 2.1 time: 0.066430 Sep 01 00:30:59.050309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 70/142] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:30:58 2022] DELETE /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:30:59.062165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:30:59.062791 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] [instance: 3ed053e9-b2ff-4c41-9a71-344e192fc7ca] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:30:59.065426 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:59.066790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:59.067604 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:59.068571 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:59.069189 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:59.070364 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:59.080134 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:59.080683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:59.081289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:59.082273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:30:59.084859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:30:59.085320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:30:59.117700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] HTTP exception thrown: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Request method failure captured: Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca HTTP/1.1 Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0KhNNvCDq_8fuLUPLoHV1AymGtr-uoaVfAIACP3AN2YC2pC_p1XkH_NEoGKebNhovjISrIcp77b9BQj-mv83RYIWUlLYLTwGnbEaA8WEIx1cf13abrVmkLGPodk8GPihUSsvSLKS9Xw1UBlplgjSHtgg2z6ci7tuXivJxNCY9Jlzw Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:30:59.119257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/eb6a951afecc44219772f82bb09f91e3"}]}] Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: eb6a951afecc44219772f82bb09f91e3 Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-DeleteServersTestJSON-1189540849 Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 6f67deff06894bffb9ac99680df14b88 Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-DeleteServersTestJSON-1189540849-project Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.120451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '3ed053e9-b2ff-4c41-9a71-344e192fc7ca'} Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:30:59.121138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. Sep 01 00:30:59.122211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:30:59.123790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] Returning 404 to user: Instance 3ed053e9-b2ff-4c41-9a71-344e192fc7ca could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:30:59.123790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f9f10196-79a3-4890-a088-368f04538f24 tempest-DeleteServersTestJSON-1189540849 tempest-DeleteServersTestJSON-1189540849-project] 10.222.0.25 "GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca" status: 404 len: 111 microversion: 2.1 time: 0.068592 Sep 01 00:30:59.128908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 71/143] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:59 2022] GET /compute/v2.1/servers/3ed053e9-b2ff-4c41-9a71-344e192fc7ca => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:30:59.337655 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:30:59.348705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6376e174-2d94-4ec8-bebc-c5703ae4b00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.323858 Sep 01 00:30:59.349287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 73/144] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:30:59 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:00.041132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:00.041828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:00.052290 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:00.053060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:00.053780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:00.054669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:00.055394 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:00.056182 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:00.368538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:00.370354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:00.371587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:00.377823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:00.378345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:00.378749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:00.379460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:00.379916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:00.380344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:00.381011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-29dea0a5-8118-4080-976a-7312e61619ad tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.343613 Sep 01 00:31:00.394122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 72/145] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:00 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:00.720924 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:00.733536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4bfde76b-5e3e-4a09-8da0-541e515ff40e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.367147 Sep 01 00:31:00.735056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 74/146] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:00 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:01.407490 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:01.409374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:01.418506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:01.420367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:01.422551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:01.423767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:01.424391 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:01.424996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:01.756430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:01.757815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:01.765446 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:01.766147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:01.766789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:01.767534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:01.768271 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:01.768876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:02.010558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:02.022090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d68c5bd6-ca58-4d69-b653-335b933dd13d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.269588 Sep 01 00:31:02.036316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:01 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:02.127945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:02.143998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-45d35d37-2c3c-49db-99d1-3bdbc07a97a1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.743316 Sep 01 00:31:02.157777 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 73/148] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:01 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:03.045183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:03.046645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:03.066667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:03.068183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:03.068887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:03.069839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:03.070993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:03.071769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:03.172439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:03.175293 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:03.194642 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:03.201639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:03.202992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:03.206097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:03.207573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:03.209310 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:03.487401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:03.509493 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-142b0eb7-fe43-4a7d-be1d-3bd94e00ca74 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.340861 Sep 01 00:31:03.511308 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 74/149] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:03 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:03.606337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:03.618199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-729e7db1-75cb-42f8-993e-a3d2477f72a5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.578778 Sep 01 00:31:03.620572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 76/150] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:03 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:04.541900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:04.542687 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:04.565773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:04.566169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:04.566684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:04.567410 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:04.569741 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:04.570807 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:04.642369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:04.643608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:04.650628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:04.651119 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:04.651561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:04.652286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:04.652760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:04.653188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:04.881954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:04.897500 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-13d1a24d-8191-47a8-9e32-1ca6ccd716b8 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.366753 Sep 01 00:31:04.902175 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 75/151] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:04 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:05.028205 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:05.039312 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-294a505f-709f-4e49-917a-75ce814bdf1c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.400633 Sep 01 00:31:05.044630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 77/152] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:04 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:05.919703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:05.921003 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:05.923352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:05.924244 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=8 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:05.931436 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:05.932763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:05.933314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:05.934116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:05.935219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:05.936254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:06.068251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:06.069416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:06.084036 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:06.084777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:06.085521 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:06.086427 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:06.087050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:06.087670 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:06.235482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:06.246457 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-37e35137-6183-4091-a49e-7321f2878e28 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.332081 Sep 01 00:31:06.253740 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 76/153] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:05 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:06.304832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:06.317993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8422b017-cb8b-49e5-a8cd-d7014a7eb00f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.252989 Sep 01 00:31:06.332667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 78/154] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:06 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:06.936241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-ce5be540-cbfc-4f0f-be22-26920d836115 req-2c52f069-fd77-4ef6-a8df-57d38ff9e993 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867565ea-56a1-4b0e-b460-aaf5cf1d5ab9", "name": "network-vif-plugged", "status": "completed", "tag": "f8a5a111-5501-4201-b519-ba90695b7bc1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:06.959558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-ce5be540-cbfc-4f0f-be22-26920d836115 req-2c52f069-fd77-4ef6-a8df-57d38ff9e993 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:06.960789 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-ce5be540-cbfc-4f0f-be22-26920d836115 req-2c52f069-fd77-4ef6-a8df-57d38ff9e993 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:06.967241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-ce5be540-cbfc-4f0f-be22-26920d836115 req-2c52f069-fd77-4ef6-a8df-57d38ff9e993 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:07.008372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-ce5be540-cbfc-4f0f-be22-26920d836115 req-2c52f069-fd77-4ef6-a8df-57d38ff9e993 service nova] Creating event network-vif-plugged:f8a5a111-5501-4201-b519-ba90695b7bc1 for instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 on hv-cinder-82002 Sep 01 00:31:07.019516 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-ce5be540-cbfc-4f0f-be22-26920d836115 req-2c52f069-fd77-4ef6-a8df-57d38ff9e993 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088758 Sep 01 00:31:07.023421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 77/155] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:07.275248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:07.275857 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:07.295538 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:07.296110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:07.296564 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:07.297288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:07.297776 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:07.298329 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:07.358853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:07.360022 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:07.379801 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:07.380284 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:07.383847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:07.384952 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:07.385572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:07.386232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:07.588592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:07.601019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bebd33d0-7d41-43ce-bda1-964cd3d1ff81 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.329426 Sep 01 00:31:07.601569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 79/156] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:07 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:08.082922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:08.114642 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bd03b460-dac2-47ca-a455-d6c9d5d13587 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.763027 Sep 01 00:31:08.121543 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:07 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:08.623270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:08.623896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:08.635657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:08.636152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:08.636617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:08.637324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:08.638316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:08.638775 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:08.865682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:08.875745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7aa7ef5b-da47-4ce7-8fbd-842c168398d6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1314 microversion: 2.1 time: 0.255048 Sep 01 00:31:08.880421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 80/158] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:08 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:09.145453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:09.146051 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:09.162606 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:09.163345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:09.163789 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:09.164488 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:09.165129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:09.165550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:09.649826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:09.658624 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8c150a6e-4a0a-4e14-a267-5d043bc28005 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.517501 Sep 01 00:31:09.659565 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 79/159] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:09 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:09.900800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:09.902020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:09.911959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:09.912529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:09.913101 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:09.914709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:09.915241 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:09.916935 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:10.124656 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:10.129399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:10.139179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-84549142-6af6-46e0-bea7-6fdb88ea2344 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1498 microversion: 2.1 time: 0.245774 Sep 01 00:31:10.140054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 81/160] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:09 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1498 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:10.679947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:10.680578 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:10.695240 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:10.695774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:10.696455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:10.697390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:10.697855 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:10.700811 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:10.915672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:10.916162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:10.926858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:10.927662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:10.928249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:10.929891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:10.930505 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:10.931101 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:10.962165 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:31:11.065657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ef47767d-707c-4905-83cb-af1a8206189e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 204 len: 0 microversion: 2.1 time: 0.153234 Sep 01 00:31:11.070356 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 82/161] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:31:10 2022] DELETE /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:31:11.079062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:11.079938 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:11.087453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:11.087981 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:11.088520 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:11.089218 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:11.089626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:11.090050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:11.259874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:11.268929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f2a11a82-14a3-4ac6-abe5-9b5b66721300 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.593146 Sep 01 00:31:11.283267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 80/162] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:10 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:11.287434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:11.301172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e586e85a-b574-4ccf-9484-8c67d96f68de tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1504 microversion: 2.1 time: 0.228960 Sep 01 00:31:11.302012 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 83/163] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:11 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:12.291601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:12.292227 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:12.312282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:12.312825 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:12.313257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:12.313959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:12.314405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:12.314827 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:12.322714 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:12.323322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:12.342623 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:12.343122 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:12.343552 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:12.344255 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:12.344732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:12.345152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:12.599442 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:12.610695 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-86d1224d-b86e-41ce-a350-86f8c6aa43b8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.323610 Sep 01 00:31:12.611696 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 81/164] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:12 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:12.701200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:12.713359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e552dd76-6fa0-4c7b-bcc9-0f306682505d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1504 microversion: 2.1 time: 0.392750 Sep 01 00:31:12.714504 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 84/165] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:12 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1504 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:13.634120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:13.634120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:13.654049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:13.654564 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:13.658065 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:13.658993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:13.660900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:13.661349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:13.741460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:13.742645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:13.753402 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:13.753920 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:13.754376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:13.763190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:13.765869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:13.766618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:14.105183 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:14.126757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-aea697bd-5be4-428a-9149-c0891e0dcdcb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.488219 Sep 01 00:31:14.198596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 82/166] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:13 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:14.313292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:14.321157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-de729ec3-6874-4409-9251-2a796334a6e3 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1504 microversion: 2.1 time: 0.584008 Sep 01 00:31:14.321747 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 85/167] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:13 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1504 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:14.974277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-48776382-0c30-4e35-84ba-34eb02475955 req-0f83a804-7aae-4bbc-ad5b-1d8e8f87c8db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "867565ea-56a1-4b0e-b460-aaf5cf1d5ab9", "name": "network-vif-deleted", "tag": "f8a5a111-5501-4201-b519-ba90695b7bc1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:15.018696 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-48776382-0c30-4e35-84ba-34eb02475955 req-0f83a804-7aae-4bbc-ad5b-1d8e8f87c8db service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:15.019195 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-48776382-0c30-4e35-84ba-34eb02475955 req-0f83a804-7aae-4bbc-ad5b-1d8e8f87c8db service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:15.023481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-48776382-0c30-4e35-84ba-34eb02475955 req-0f83a804-7aae-4bbc-ad5b-1d8e8f87c8db service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:15.058217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-48776382-0c30-4e35-84ba-34eb02475955 req-0f83a804-7aae-4bbc-ad5b-1d8e8f87c8db service nova] Creating event network-vif-deleted:f8a5a111-5501-4201-b519-ba90695b7bc1 for instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 on hv-cinder-82002 Sep 01 00:31:15.079076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-48776382-0c30-4e35-84ba-34eb02475955 req-0f83a804-7aae-4bbc-ad5b-1d8e8f87c8db service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115684 Sep 01 00:31:15.081948 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 83/168] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:15.201175 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:15.201799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:15.208487 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:15.220715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:15.221407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:15.222346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:15.222806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:15.223419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:15.346378 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:15.347274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:15.365224 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:15.365703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:15.366148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:15.371383 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:15.372603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:15.373052 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:15.461422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:15.462390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:15.463298 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:15.464168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lazy-loading 'fault' on Instance uuid 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:31:15.469837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=100 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:15.622236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:15.646192 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a742c55a-3d52-4c86-868f-40b10cc40944 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 200 len: 1304 microversion: 2.1 time: 0.303904 Sep 01 00:31:15.656120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 84/169] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:15 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 1304 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:15.801163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:15.813601 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a08c5fdc-88dd-44df-8074-866604c3824d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.622895 Sep 01 00:31:15.814195 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 86/170] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:15 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:16.278103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-797e504f-12c3-476d-a864-a41b65874784 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: .version_select at 0x7fcadffb6550>, body: {"keypair": {"name": "tempest-keypair-2084636291", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQDaLLgETtTjrG0P+KATiDU1hyjLwuh+htRyNY0QuCMsMrETDxPF+GqK3nYJaem8rZ0IkAtaKMSW52c+KPQ+w+mdK7Bi86enkBtEOV9ge5m2kTQ75nBNAM9Hb7YPespkg=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:16.278825 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-678810b0-efc1-4a0e-a8f5-f5b66b869ae5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Action: 'create', calling method: .version_select at 0x7fcae406cca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1494052932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPXFsUO+jaeihitSWVXprmhvUiQYv1DiKzX9f3cMB0XQYbpRYR7TkPC+4LCI3jd8FOxZR5FC91pS15lSBk5oSp8kLq9zr168i4psqmtwAC3cmWtrkigGUTwO4/8ZSC3LqQ=="}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:16.302035 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-797e504f-12c3-476d-a864-a41b65874784 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:31:16.306574 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-797e504f-12c3-476d-a864-a41b65874784 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:31:16.308602 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-678810b0-efc1-4a0e-a8f5-f5b66b869ae5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Getting quotas for project 3f39cdb9221440658d7cd52c341cf08a. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:31:16.314021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-678810b0-efc1-4a0e-a8f5-f5b66b869ae5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Getting quotas for user af0e23f782c74c5d896ab24b64b43b18 and project 3f39cdb9221440658d7cd52c341cf08a. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:31:16.344600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-797e504f-12c3-476d-a864-a41b65874784 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.290534 Sep 01 00:31:16.349547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 87/171] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:31:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:16.378337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-678810b0-efc1-4a0e-a8f5-f5b66b869ae5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.460633 Sep 01 00:31:16.379794 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 85/172] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:31:15 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:31:16.681196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:16.682308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:16.707282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:16.710480 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:16.711988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:16.714028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:16.715355 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:16.721410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:16.774086 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] HTTP exception thrown: Instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 could not be found. Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Request method failure captured: Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 HTTP/1.1 Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_08dyAUJ5rFVCxqTZG9DZ6hiETqKE3Z77OD_3b9e3aLk5x0CssVR3dec_OT7WydEWF71DVDbS90Ehuxi9QaG-FPXTxRtbSf1TOL0rdnRzF1yGXOEo_iNMHJSIvQ2vMw4RAfw-1kI2urT56T6zZvXXPGuolQdzhY6HjqyJj8JjTu5No Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 32e68213ef7041a79aaaf1d255d2395e Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesActionsTest-1372455104 Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:31:16.777557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_32e68213ef7041a79aaaf1d255d2395e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/32e68213ef7041a79aaaf1d255d2395e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/32e68213ef7041a79aaaf1d255d2395e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/32e68213ef7041a79aaaf1d255d2395e"}]}] Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesActionsTest-1372455104 Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 32e68213ef7041a79aaaf1d255d2395e Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesActionsTest-1372455104 Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesActionsTest-1372455104-project Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: b86acd50276842a3bc18e3ffa00e515a Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesActionsTest-1372455104-project Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 could not be found. Sep 01 00:31:16.779371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '867565ea-56a1-4b0e-b460-aaf5cf1d5ab9'} Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 could not be found. Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:31:16.780215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 could not be found. Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 could not be found. Sep 01 00:31:16.782802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:16.784959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Returning 404 to user: Instance 867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:31:16.784959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6571da4b-1e8f-4e0a-9936-701274de52b9 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9" status: 404 len: 111 microversion: 2.1 time: 0.108299 Sep 01 00:31:16.800530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 88/173] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:16 2022] GET /compute/v2.1/servers/867565ea-56a1-4b0e-b460-aaf5cf1d5ab9 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:31:16.841608 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:16.851257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:16.863312 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:16.868707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:16.869394 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:16.870474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:16.871117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:16.872488 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:17.020908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1113360182", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "networks": [{"uuid": "02802a57-7829-47a2-bef9-81183594c96f"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:17.113408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] validate_networks() for [('02802a57-7829-47a2-bef9-81183594c96f', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:31:17.206139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:17.215859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e10f81c0-07eb-4113-8a8f-01f2c5bd3744 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.378925 Sep 01 00:31:17.218720 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 86/174] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:16 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:17.723129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:31:17.723717 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:31:17.724192 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:31:17.725263 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:31:17.725900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:31:17.744570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:17.745502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:17.748178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:17.752110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:17.752790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:17.753507 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:17.800900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Getting quotas for project 32e68213ef7041a79aaaf1d255d2395e. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:31:17.812391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Getting quotas for user b86acd50276842a3bc18e3ffa00e515a and project 32e68213ef7041a79aaaf1d255d2395e. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:31:17.831846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:31:17.835257 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:31:17.920871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7b46be78-7f6e-4816-9b0f-19f2ea6bad30 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.904645 Sep 01 00:31:17.921897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 89/175] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:31:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:31:17.944779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f0cf7b2f-38df-4a74-80a3-0a39e20ca757 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:17.946883 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f0cf7b2f-38df-4a74-80a3-0a39e20ca757 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:18.086418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f0cf7b2f-38df-4a74-80a3-0a39e20ca757 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:18.105619 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f0cf7b2f-38df-4a74-80a3-0a39e20ca757 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1214 microversion: 2.1 time: 0.174016 Sep 01 00:31:18.122608 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 87/176] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:17 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:18.253983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:18.254744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:18.285162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:18.305353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:18.305956 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:18.309743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:18.312263 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:18.315206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:18.641025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:18.669576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2a611899-8121-49c8-ae8b-c91c7bc1711f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.417117 Sep 01 00:31:18.686658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 90/177] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:18 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:18.975380 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2143967957", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c58401f2-7e87-4905-8554-61c4ec2b1ce1"}], "security_groups": [{"name": "tempest-securitygroup--299207554"}], "key_name": "tempest-keypair-2084636291", "user_data": "}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:19.128167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:19.128955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:19.144099 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:19.148238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:19.148960 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:19.149988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:19.150659 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:19.151315 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:19.188643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] validate_networks() for [('c58401f2-7e87-4905-8554-61c4ec2b1ce1', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:31:19.333969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:19.342352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5cb2b04b-7d41-4692-a17f-b3d145987c22 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1266 microversion: 2.1 time: 0.218187 Sep 01 00:31:19.344545 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 91/178] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:19 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1266 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:19.698123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:19.698872 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:19.713450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:19.716302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:19.717558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:19.720640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:19.721342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:19.722689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:19.822796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:31:19.823350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:31:19.823836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:31:19.824246 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:31:19.824774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:31:19.859998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:19.860860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:19.862376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:19.864615 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:19.865270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:19.865897 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:19.911341 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:31:19.916070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:31:19.936863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:31:19.939287 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:31:19.989505 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:20.007339 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6d222239-21b4-4ba0-a07b-4657a89c10a1 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.318581 Sep 01 00:31:20.007774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-41c088e0-09f9-4f11-b2e8-7170253d2124 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.037751 Sep 01 00:31:20.009385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 92/179] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:19 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:20.026327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 88/180] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:31:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1057 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:31:20.039423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-804311a6-a2a1-4e6a-a474-38567a1ab10f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:20.040197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-804311a6-a2a1-4e6a-a474-38567a1ab10f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:20.122079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-804311a6-a2a1-4e6a-a474-38567a1ab10f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:20.134149 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-804311a6-a2a1-4e6a-a474-38567a1ab10f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1242 microversion: 2.1 time: 0.099752 Sep 01 00:31:20.148211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 93/181] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:20 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1242 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:20.366194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:20.366808 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:20.385816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:20.386334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:20.386952 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:20.394206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:20.394206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:20.394936 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:20.537276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:20.549354 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-048e861e-78e4-4a61-a264-3a3bea2e07b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1266 microversion: 2.1 time: 0.187044 Sep 01 00:31:20.550308 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 89/182] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:20 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:21.040682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:21.041724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:21.054647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:21.055342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:21.055830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:21.056741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:21.057181 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:21.057612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:21.155884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:21.158969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:21.170971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:21.172028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:21.172487 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:21.173351 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:21.174090 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:21.174754 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:21.301146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:21.310172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e5a227da-0cb7-4704-bb63-911f9c3fc10a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1238 microversion: 2.1 time: 0.158238 Sep 01 00:31:21.311855 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 90/183] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:21 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1238 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:21.363087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:21.374384 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bb451066-1682-4fa6-b799-b4522bfe54fe tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1521 microversion: 2.1 time: 0.337740 Sep 01 00:31:21.374977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 94/184] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:21 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:21.577999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:21.578604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:21.584689 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:21.585405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:21.585836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:21.586513 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:21.586956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:21.587373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:21.676230 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:21.686198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5dc5dff4-393e-4d4a-a9ca-9c529f4e573e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1284 microversion: 2.1 time: 0.112489 Sep 01 00:31:21.686780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 91/185] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:21 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:22.335203 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:22.335971 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:22.343596 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.344560 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.345004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.346432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.347288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.347746 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.395495 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:22.396179 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:22.402993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.403458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.404104 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.404835 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.405300 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.405706 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.417435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:22.426194 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d649c330-682a-45a1-8453-e6c3fe98e97f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1294 microversion: 2.1 time: 0.098096 Sep 01 00:31:22.426816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 95/186] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:22 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:22.548216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:22.557091 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-04714012-a845-43c3-81af-5f73649ec545 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1501 microversion: 2.1 time: 0.165774 Sep 01 00:31:22.557656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 92/187] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:22 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:22.576793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:22.577627 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:22.583733 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.584151 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.584609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.585298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.585908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.586331 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.712034 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:22.719405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:22.739912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.740462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:22.744268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.751710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7df21c5a-48a2-438b-a3f0-85326bc7be9f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1515 microversion: 2.1 time: 0.178752 Sep 01 00:31:22.751914 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.756881 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:22.757201 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 96/188] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:22 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1515 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:22.757728 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:22.758301 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:22.924158 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:22.932099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a32f50f2-8328-440c-a939-7262379a043e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.227298 Sep 01 00:31:22.933108 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 93/189] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:22 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:23.447636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:23.448794 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:23.456243 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:23.457016 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:23.457485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:23.458300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:23.458757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:23.459175 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:23.703931 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:23.712814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5bd77d87-baed-4b4a-9651-337de03d0b4d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1300 microversion: 2.1 time: 0.269333 Sep 01 00:31:23.713511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 97/190] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:23 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1300 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:23.955640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:23.956255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:23.962844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:23.963578 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:23.964167 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:23.965334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:23.966153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:23.966917 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.052377 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-c8bd8f67-2e9c-47dc-a0a3-5111727eae8e req-f8bd000e-2af9-4902-a27b-d6f215a59154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa552b4e-20f4-408a-8bfe-ad4989188b48", "tag": "06e6513e-9ce3-422d-a4a1-ced5f0ec100b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:24.065759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c8bd8f67-2e9c-47dc-a0a3-5111727eae8e req-f8bd000e-2af9-4902-a27b-d6f215a59154 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.066334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c8bd8f67-2e9c-47dc-a0a3-5111727eae8e req-f8bd000e-2af9-4902-a27b-d6f215a59154 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.066837 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c8bd8f67-2e9c-47dc-a0a3-5111727eae8e req-f8bd000e-2af9-4902-a27b-d6f215a59154 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.089576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-c8bd8f67-2e9c-47dc-a0a3-5111727eae8e req-f8bd000e-2af9-4902-a27b-d6f215a59154 service nova] Creating event network-changed:06e6513e-9ce3-422d-a4a1-ced5f0ec100b for instance fa552b4e-20f4-408a-8bfe-ad4989188b48 on hv-cinder-82002 Sep 01 00:31:24.098085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-c8bd8f67-2e9c-47dc-a0a3-5111727eae8e req-f8bd000e-2af9-4902-a27b-d6f215a59154 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049523 Sep 01 00:31:24.099669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 98/191] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:24.230915 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:24.243187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cc1fffae-30e0-4109-abdd-87bde4a251ba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.291293 Sep 01 00:31:24.257443 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 94/192] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:23 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:24.329906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:24.333423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:24.341740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.342531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.343181 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.344037 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.344716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.345312 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.374800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'flavor' on Instance uuid f5dc5608-df5a-4c41-9d46-fd161e18e075 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:31:24.447771 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:24.503374 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a3d31a62-2433-4be2-93db-e8c95076421b tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/action" status: 200 len: 32 microversion: 2.1 time: 0.178572 Sep 01 00:31:24.503975 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 99/193] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:31:24 2022] POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:31:24.513665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:24.514278 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:24.520339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.520860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.521292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.522219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.522669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.523093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.735321 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:24.736625 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:24.744689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.745430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.746141 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.747350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:24.748538 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:24.749358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:24.778431 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:24.800173 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7469d766-70e3-455f-9b71-315b53068ea2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.290367 Sep 01 00:31:24.802407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 95/194] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:24 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:24.965287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:24.973563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f2cc2de0-2424-43af-b848-fca1eb16dd98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.242730 Sep 01 00:31:24.974250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 100/195] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:24 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:25.240553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-9c694d41-af12-4f96-a10c-81fe4b48581f req-c9bc0ca8-694c-4972-9056-b5311be1d5a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50b662a-3c38-40f3-92b5-37f693b80d25", "tag": "299fe693-858d-4ad5-9a80-e1369ca617bf"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:25.256305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9c694d41-af12-4f96-a10c-81fe4b48581f req-c9bc0ca8-694c-4972-9056-b5311be1d5a6 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:25.256922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9c694d41-af12-4f96-a10c-81fe4b48581f req-c9bc0ca8-694c-4972-9056-b5311be1d5a6 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:25.257471 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9c694d41-af12-4f96-a10c-81fe4b48581f req-c9bc0ca8-694c-4972-9056-b5311be1d5a6 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:25.266002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:25.266696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:25.272423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-9c694d41-af12-4f96-a10c-81fe4b48581f req-c9bc0ca8-694c-4972-9056-b5311be1d5a6 service nova] Creating event network-changed:299fe693-858d-4ad5-9a80-e1369ca617bf for instance d50b662a-3c38-40f3-92b5-37f693b80d25 on hv-cinder-82002 Sep 01 00:31:25.276720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:25.277214 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:25.278200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:25.278557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-9c694d41-af12-4f96-a10c-81fe4b48581f req-c9bc0ca8-694c-4972-9056-b5311be1d5a6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041004 Sep 01 00:31:25.279610 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 96/196] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:31:25.281376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:25.281849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:25.282279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:25.421877 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:25.429465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-aa71bcd3-2566-4204-adb4-ecd185e4cb64 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.168138 Sep 01 00:31:25.430033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 101/197] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:25 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:25.823100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:25.823943 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:25.835276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:25.835882 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:25.836315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:25.837056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:25.837508 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:25.837928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:25.993580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:25.994184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:26.001516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:26.003015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:26.004117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:26.005242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:26.005716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:26.006264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:26.078382 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:26.087715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f621b627-7a27-4955-aae5-4b1c8af48ad8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.268908 Sep 01 00:31:26.088290 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 97/198] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:25 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:26.450996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:26.451591 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:26.453588 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:26.459406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:26.459889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:26.460318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:26.461130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:26.461562 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:26.462197 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:26.475582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:26.491916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-73cb725d-341d-4326-86a8-1f602878c98d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.502220 Sep 01 00:31:26.500002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 102/199] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:25 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:26.618770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:26.626899 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8cc9c8a6-cb94-43f7-ad48-437e58dcb6b1 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.180153 Sep 01 00:31:26.627455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:26 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:27.109536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:27.110438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:27.117262 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:27.117748 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:27.118179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:27.118879 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:27.119503 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:27.120128 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:27.512725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:27.513354 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:27.519551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:27.520027 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:27.520465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:27.521193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:27.521644 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:27.522062 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:27.545265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:27.567282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1df7cd30-71ac-4602-ba22-9d4fdd67d3c3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.461829 Sep 01 00:31:27.568277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 103/201] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:27 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:27.649246 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:27.649692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:27.651498 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:27.656433 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:27.656950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:27.657392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:27.658092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:27.658543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:27.658974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:27.659817 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-36776f90-b65a-41da-9443-66768da8574b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.151163 Sep 01 00:31:27.660515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 99/202] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:27 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:27.780570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:27.788228 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:27.795790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ffecb684-126a-4c90-aea0-d29b5a2eca47 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.150653 Sep 01 00:31:27.796353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 104/203] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:27 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:28.588884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:28.590209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:28.597227 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.597814 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.598347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.599168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.599717 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.600271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.684193 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:28.685705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:28.694804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.695300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.695735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.696643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.697254 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.697687 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.763598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:28.775838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d46f7b29-e2e9-45a4-8d0b-a0dec2168ce0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.190774 Sep 01 00:31:28.790751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 100/204] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:28 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:28.796334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-48e2a7f8-5001-4a90-b63f-cad2601c8911 req-cc953c28-9e65-4caa-a355-aa25fcdb4bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa552b4e-20f4-408a-8bfe-ad4989188b48", "name": "network-vif-plugged", "status": "completed", "tag": "06e6513e-9ce3-422d-a4a1-ced5f0ec100b"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:28.806159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-48e2a7f8-5001-4a90-b63f-cad2601c8911 req-cc953c28-9e65-4caa-a355-aa25fcdb4bae service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.806736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-48e2a7f8-5001-4a90-b63f-cad2601c8911 req-cc953c28-9e65-4caa-a355-aa25fcdb4bae service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.807280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-48e2a7f8-5001-4a90-b63f-cad2601c8911 req-cc953c28-9e65-4caa-a355-aa25fcdb4bae service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.821600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-48e2a7f8-5001-4a90-b63f-cad2601c8911 req-cc953c28-9e65-4caa-a355-aa25fcdb4bae service nova] Creating event network-vif-plugged:06e6513e-9ce3-422d-a4a1-ced5f0ec100b for instance fa552b4e-20f4-408a-8bfe-ad4989188b48 on hv-cinder-82002 Sep 01 00:31:28.832381 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-48e2a7f8-5001-4a90-b63f-cad2601c8911 req-cc953c28-9e65-4caa-a355-aa25fcdb4bae service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040090 Sep 01 00:31:28.833221 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 101/205] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:28.838660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:28.839455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:28.846533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.847430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.847856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.848770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:28.849448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:28.849971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:28.894950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:28.911372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-49c7352d-a420-45e8-8210-c100f95ec51e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.233827 Sep 01 00:31:28.916547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 105/206] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:28 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:29.025572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:29.036145 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-35187bce-7e29-47ac-84f1-cddbc1b62310 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.201619 Sep 01 00:31:29.036760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 102/207] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:28 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:29.799662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:29.800262 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:29.802564 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:29.807693 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:29.808281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:29.809342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:29.810131 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:29.810580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:29.811092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:29.932660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:29.933269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:29.935332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:29.936155 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=12 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:29.942421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:29.942895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:29.943323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:29.944004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:29.944453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:29.944912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:29.947298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:29.955740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7fc5c5ea-c5b2-44c1-ab00-b750b91219d4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.159925 Sep 01 00:31:29.956315 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 106/208] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:29 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:30.057783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:30.058467 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:30.065186 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:30.065851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:30.066704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:30.066962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:30.067406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:30.067821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:30.085148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:30.093881 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c9e19f99-e0c4-4031-b403-553444e6d8bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.165028 Sep 01 00:31:30.094528 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 103/209] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:29 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:30.125860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=12 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:30.212899 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:30.221557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-94d70f37-3266-411a-9a63-961e09e202f7 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1314 microversion: 2.1 time: 0.167917 Sep 01 00:31:30.222246 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 107/210] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:30 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:30.976462 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:30.977094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:30.984262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:30.984711 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:30.985183 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:30.985874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:30.986326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:30.986753 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.115858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:31.117203 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:31.124184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:31.124968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:31.125611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.126506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:31.127152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:31.127747 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.147087 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:31.155571 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d27bdffc-f1ad-4b01-a711-8f1fbe6996c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.182909 Sep 01 00:31:31.156328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 104/211] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:30 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:31.243029 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:31.244439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:31.251226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:31.251800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:31.252298 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.253235 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:31.253990 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:31.254649 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.259078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=100 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:31.277020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:31.289629 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6bbaa9ca-ead4-4cea-b6b9-1b2c9c4c44fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.178183 Sep 01 00:31:31.290212 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 108/212] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:31 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:31.394460 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:31.402178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9be69bc5-c9c1-4881-946c-2b9f754b1d5f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1499 microversion: 2.1 time: 0.163133 Sep 01 00:31:31.402945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 105/213] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:31 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1499 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:31.960183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:31.961109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:31.968835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:31.969314 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:31.969739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.970420 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:31.970871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:31.971290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:31.999106 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:31:32.077415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-12bdb9b2-83e8-470f-8875-806947ccda39 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "DELETE /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 204 len: 0 microversion: 2.1 time: 0.120855 Sep 01 00:31:32.078214 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 109/214] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:31:31 2022] DELETE /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:31:32.088613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:32.089243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:32.096012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.096488 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.096960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.097644 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.098083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.098494 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.177625 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:32.178322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:32.185139 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.185623 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.186059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.186755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.187205 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.187628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.251935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:32.260100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b7ba7840-7004-4aec-988a-f649cfb8d4a6 tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1505 microversion: 2.1 time: 0.177282 Sep 01 00:31:32.260707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 106/215] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:32 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:32.310053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:32.310714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:32.316617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.317094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.317524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.318208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.318678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.319124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.333357 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:32.342176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3504e186-442c-4d3b-afc4-c08dfa4a1649 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.168865 Sep 01 00:31:32.342847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 110/216] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:32 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:32.454169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:32.462524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ca0e0e6f-6fdc-41ac-9253-f0182b8d8fbf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.156822 Sep 01 00:31:32.463123 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 107/217] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:32 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:32.709576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-2b1a127c-b75d-4325-b54f-d4499e7c77f8 req-3b513c2e-3939-449b-abba-293550687be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50b662a-3c38-40f3-92b5-37f693b80d25", "name": "network-vif-plugged", "status": "completed", "tag": "299fe693-858d-4ad5-9a80-e1369ca617bf"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:32.721367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2b1a127c-b75d-4325-b54f-d4499e7c77f8 req-3b513c2e-3939-449b-abba-293550687be5 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:32.721843 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2b1a127c-b75d-4325-b54f-d4499e7c77f8 req-3b513c2e-3939-449b-abba-293550687be5 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:32.722301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2b1a127c-b75d-4325-b54f-d4499e7c77f8 req-3b513c2e-3939-449b-abba-293550687be5 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:32.733684 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-2b1a127c-b75d-4325-b54f-d4499e7c77f8 req-3b513c2e-3939-449b-abba-293550687be5 service nova] Creating event network-vif-plugged:299fe693-858d-4ad5-9a80-e1369ca617bf for instance d50b662a-3c38-40f3-92b5-37f693b80d25 on hv-cinder-82002 Sep 01 00:31:32.738327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-2b1a127c-b75d-4325-b54f-d4499e7c77f8 req-3b513c2e-3939-449b-abba-293550687be5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032753 Sep 01 00:31:32.738921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 111/218] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:33.283232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:33.283844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:33.289938 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:33.290454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:33.290938 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:33.291624 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:33.292075 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:33.292628 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:33.363032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:33.363736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:33.369860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:33.370565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:33.371501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:33.371820 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:33.372265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:33.372712 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:33.432171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:33.442137 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6876eb55-a232-48d8-a857-149ff8fec67f tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1505 microversion: 2.1 time: 0.162465 Sep 01 00:31:33.443246 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 108/219] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:33 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:33.483309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:33.484018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:33.490041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:33.490517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:33.490947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:33.491635 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:33.492076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:33.492509 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:33.513264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:33.521044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-25fe6488-33de-4f93-9af2-5ecdc941eba9 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.162728 Sep 01 00:31:33.521749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 112/220] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:33 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:33.644544 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:33.653326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-baa1ff72-4261-4c39-943d-f73626f98885 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.173924 Sep 01 00:31:33.654271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 109/221] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:33 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:34.468305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:34.469043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:34.475846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.476484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.477047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.478346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.478556 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.479045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.542524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:34.543132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:34.549372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.550057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.550567 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.551381 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.551901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.552398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.671932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:34.680075 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-81ab8ecf-2269-4be3-b0c5-beb2b662c99d tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1505 microversion: 2.1 time: 0.215691 Sep 01 00:31:34.692527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 113/222] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:34 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1505 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:34.692527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:34.692527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:34.693196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.694089 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.694755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.695609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.696162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.696739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.719574 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:34.725582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:34.734273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-aad4ca8f-9dcf-445e-9c81-4325898e5032 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.195502 Sep 01 00:31:34.734964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 110/223] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:34 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:34.776487 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-a2c90af2-a784-4f87-bd56-65c9024ee351 req-fa23305a-fc17-4e8b-81d5-fe9ac2c7eb4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa552b4e-20f4-408a-8bfe-ad4989188b48", "name": "network-vif-deleted", "tag": "06e6513e-9ce3-422d-a4a1-ced5f0ec100b"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:34.789895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-a2c90af2-a784-4f87-bd56-65c9024ee351 req-fa23305a-fc17-4e8b-81d5-fe9ac2c7eb4d service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.790473 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-a2c90af2-a784-4f87-bd56-65c9024ee351 req-fa23305a-fc17-4e8b-81d5-fe9ac2c7eb4d service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.791005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-a2c90af2-a784-4f87-bd56-65c9024ee351 req-fa23305a-fc17-4e8b-81d5-fe9ac2c7eb4d service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.805798 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-a2c90af2-a784-4f87-bd56-65c9024ee351 req-fa23305a-fc17-4e8b-81d5-fe9ac2c7eb4d service nova] Creating event network-vif-deleted:06e6513e-9ce3-422d-a4a1-ced5f0ec100b for instance fa552b4e-20f4-408a-8bfe-ad4989188b48 on hv-cinder-82002 Sep 01 00:31:34.813139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-a2c90af2-a784-4f87-bd56-65c9024ee351 req-fa23305a-fc17-4e8b-81d5-fe9ac2c7eb4d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040274 Sep 01 00:31:34.814308 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 111/224] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:31:34.850605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:34.851421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:34.859000 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.859714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.860987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.861698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:34.862152 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:34.862578 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:34.866701 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:34.875694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-752e73a5-4cf5-49d6-b766-8015c71b4602 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1367 microversion: 2.1 time: 0.193388 Sep 01 00:31:34.876279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 114/225] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:34 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:34.890063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4ed18958-83a0-45c9-95d8-b2ee34a51c55 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/ips" status: 200 len: 146 microversion: 2.1 time: 0.046746 Sep 01 00:31:34.890759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 112/226] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:31:34 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/ips => generated 146 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:35.705047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:35.705677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:35.713149 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.713626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.714063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.714788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.715413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.715835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.755972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.756307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:35.756818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.756960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:35.757542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.758153 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lazy-loading 'fault' on Instance uuid fa552b4e-20f4-408a-8bfe-ad4989188b48 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:31:35.765498 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.766217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.766982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.768073 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.768720 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.769596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.815313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b86acd50276842a3bc18e3ffa00e515a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32e68213ef7041a79aaaf1d255d2395e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:35.844327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-87608210-43aa-4e3a-b59c-972a63318f3e tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 200 len: 1304 microversion: 2.1 time: 0.141294 Sep 01 00:31:35.845924 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 115/227] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:35 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:35.900392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:35.901436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:35.911081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.911662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.912959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.913872 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:35.914502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:35.915098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:35.943449 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:35.951601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-23c4df71-2171-4834-8a53-03296e0ff6db tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.199700 Sep 01 00:31:35.952179 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 113/228] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:35 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:36.080559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:36.089070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-58c4df45-2dd9-4fd0-b8f2-424694b9382a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1557 microversion: 2.1 time: 0.195278 Sep 01 00:31:36.089752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 116/229] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:35 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1557 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:36.109910 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:36.110410 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:36.116878 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:36.117369 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:36.117799 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:36.118507 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:36.118956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:36.119376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:36.206851 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c8165141-1929-4769-bf44-baaf59a8ff58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100719 Sep 01 00:31:36.207467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 114/230] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:31:36 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:36.867244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:36.867855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] [instance: fa552b4e-20f4-408a-8bfe-ad4989188b48] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:36.874574 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:36.875056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:36.875489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:36.876186 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:36.876674 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:36.877097 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:36.890865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] HTTP exception thrown: Instance fa552b4e-20f4-408a-8bfe-ad4989188b48 could not be found. Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Request method failure captured: Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 HTTP/1.1 Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_08dyAUJ5rFVCxqTZG9DZ6hiETqKE3Z77OD_3b9e3aLk5x0CssVR3dec_OT7WydEWF71DVDbS90Ehuxi9QaG-FPXTxRtbSf1TOL0rdnRzF1yGXOEo_iNMHJSIvQ2vMw4RAfw-1kI2urT56T6zZvXXPGuolQdzhY6HjqyJj8JjTu5No Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 32e68213ef7041a79aaaf1d255d2395e Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesActionsTest-1372455104 Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:31:36.892524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_32e68213ef7041a79aaaf1d255d2395e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/32e68213ef7041a79aaaf1d255d2395e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/32e68213ef7041a79aaaf1d255d2395e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/32e68213ef7041a79aaaf1d255d2395e"}]}] Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesActionsTest-1372455104 Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 32e68213ef7041a79aaaf1d255d2395e Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesActionsTest-1372455104 Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesActionsTest-1372455104-project Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: b86acd50276842a3bc18e3ffa00e515a Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesActionsTest-1372455104-project Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance fa552b4e-20f4-408a-8bfe-ad4989188b48 could not be found. Sep 01 00:31:36.893967 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'fa552b4e-20f4-408a-8bfe-ad4989188b48'} Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa552b4e-20f4-408a-8bfe-ad4989188b48 could not be found. Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:31:36.894736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa552b4e-20f4-408a-8bfe-ad4989188b48 could not be found. Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa552b4e-20f4-408a-8bfe-ad4989188b48 could not be found. Sep 01 00:31:36.895871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:36.896875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] Returning 404 to user: Instance fa552b4e-20f4-408a-8bfe-ad4989188b48 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:31:36.896875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e83a5f35-f241-47f9-ad4f-1e8413decaba tempest-VolumesActionsTest-1372455104 tempest-VolumesActionsTest-1372455104-project] 10.222.0.25 "GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48" status: 404 len: 111 microversion: 2.1 time: 0.030617 Sep 01 00:31:36.896875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 117/231] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:36 2022] GET /compute/v2.1/servers/fa552b4e-20f4-408a-8bfe-ad4989188b48 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:31:36.975437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:36.976215 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:36.983263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:36.983933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:36.984362 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:36.985369 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:36.996654 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:36.996654 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:37.150186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:37.163094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-940c367d-7869-46e5-84d7-4695d30afecf tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.192136 Sep 01 00:31:37.163793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 115/232] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:36 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:37.219572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-1127ce96-f0c8-4356-8959-20e23312e0de req-c49aa452-9e40-493f-8671-f824f0c11e49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50b662a-3c38-40f3-92b5-37f693b80d25", "tag": "299fe693-858d-4ad5-9a80-e1369ca617bf"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:37.232445 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1127ce96-f0c8-4356-8959-20e23312e0de req-c49aa452-9e40-493f-8671-f824f0c11e49 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:37.232950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1127ce96-f0c8-4356-8959-20e23312e0de req-c49aa452-9e40-493f-8671-f824f0c11e49 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:37.233543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1127ce96-f0c8-4356-8959-20e23312e0de req-c49aa452-9e40-493f-8671-f824f0c11e49 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:37.248239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-1127ce96-f0c8-4356-8959-20e23312e0de req-c49aa452-9e40-493f-8671-f824f0c11e49 service nova] Creating event network-changed:299fe693-858d-4ad5-9a80-e1369ca617bf for instance d50b662a-3c38-40f3-92b5-37f693b80d25 on hv-cinder-82002 Sep 01 00:31:37.259125 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-1127ce96-f0c8-4356-8959-20e23312e0de req-c49aa452-9e40-493f-8671-f824f0c11e49 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043221 Sep 01 00:31:37.259850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 118/233] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:37.706983 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4e951db-b64a-4cfd-96ec-110ad2bc5efd"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:37.709481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:37.718194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:37.719056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:37.719798 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:37.721042 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:37.722161 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:37.722730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:38.041226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-030bd804-3bcd-4d9c-81fc-a809b13f6526 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.338571 Sep 01 00:31:38.042313 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 116/234] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:31:37 2022] POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:38.190054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:38.190889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:38.197149 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:38.197632 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:38.198073 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:38.199580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:38.200032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:38.200456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:38.340565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:38.348983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-65be0ee9-7c40-41c2-9eff-b30d1e6cd0c5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.163666 Sep 01 00:31:38.349563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 119/235] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:38 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:39.370454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:39.371283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:39.378603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:39.379078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:39.379512 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:39.380190 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:39.380684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:39.381324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:39.509102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:39.517343 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c06664eb-a94e-4cfb-8fe4-007211eb633f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.151351 Sep 01 00:31:39.517903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 117/236] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:39 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:40.538025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:40.538632 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:40.545756 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:40.546232 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:40.546660 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:40.547348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:40.547790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:40.548204 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:40.679004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:40.686701 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8f5aaf63-28be-464a-9390-4d9c15f74799 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.152519 Sep 01 00:31:40.687201 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 120/237] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:40 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:40.992924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:40.993448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:41.000110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:41.000622 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:41.001056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:41.001744 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:41.002191 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:41.002611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:41.028037 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e806148f-7205-4a17-bcd8-cd2ebf40a5fd tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/ips" status: 200 len: 152 microversion: 2.20 time: 0.039067 Sep 01 00:31:41.028610 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 118/238] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Sep 1 00:31:40 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:31:41.707270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:41.707883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:41.714763 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:41.715257 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:41.715695 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:41.716390 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:41.716875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:41.717302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:41.845094 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:41.853609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-72360a27-1b4c-4aa5-af5f-0ad2a68e6953 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.150403 Sep 01 00:31:41.854172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 121/239] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:41 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:42.875839 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:42.876447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:42.886170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:42.886658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:42.887978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:42.888732 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:42.889166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:42.889745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:43.040014 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:43.050153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b1345661-60c3-4128-a75d-138ae7acdfc2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.179380 Sep 01 00:31:43.050840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 119/240] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:42 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:43.411791 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:43.412327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:43.419937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:43.420701 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:43.421327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:43.422204 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:43.422991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:43.423566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:43.451870 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lazy-loading 'flavor' on Instance uuid 17b64cab-6c29-4261-b029-bf0bb5d3ee9a {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:31:43.656407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0c8d500a-06bc-45c2-8539-8fc6fb26d7b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/action" status: 202 len: 0 microversion: 2.20 time: 0.248677 Sep 01 00:31:43.657251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 122/241] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 00:31:43 2022] POST /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:31:43.668150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:43.669986 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:43.676717 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:43.677554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:43.678008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:43.678880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:43.679469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:43.680169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:43.822340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1386620063", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1494052932", "security_groups": [{"name": "tempest-secgroup-smoke-2112612746"}], "networks": [{"uuid": "c0b24cda-34e6-4a2a-a3b5-60c23fd152f5"}], "block_device_mapping_v2": [{"uuid": "07275763-7d69-44de-a30b-35b86964e52b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:43.884919 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:43.898550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:43.899913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:43.901526 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-dd06ae49-554b-4240-9a3c-aad25ca4e6ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.239700 Sep 01 00:31:43.917819 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 120/242] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:43 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:44.057426 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] validate_networks() for [('c0b24cda-34e6-4a2a-a3b5-60c23fd152f5', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:31:44.072109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:44.073084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:44.079768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:44.080361 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:44.080900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:44.082493 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:44.083060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:44.083691 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:44.340616 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:44.357204 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7aad19f6-cd88-48c9-bb80-753146cd2c51 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.289177 Sep 01 00:31:44.357799 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 121/243] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:44 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:44.633505 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:31:44.634020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:31:44.634408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:31:44.634816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:31:44.635226 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:31:44.648302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:44.649061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:44.649495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:44.650395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:44.650849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:44.651438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:44.673066 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Getting quotas for project 3f39cdb9221440658d7cd52c341cf08a. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:31:44.677417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Getting quotas for user af0e23f782c74c5d896ab24b64b43b18 and project 3f39cdb9221440658d7cd52c341cf08a. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:31:44.881470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:31:44.883818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07275763-7d69-44de-a30b-35b86964e52b',volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:31:44.933294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:44.935425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:44.962497 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:44.968907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:44.970546 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:44.971540 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:44.972170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:44.972782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:45.017169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:45.041848 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9bd7fe29-2af2-42e5-bf98-9da068056b3e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.226215 Sep 01 00:31:45.042923 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 123/244] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:31:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 01 00:31:45.055127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9cc4cb3a-43cf-4211-aec3-97082800a027 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:45.055933 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9cc4cb3a-43cf-4211-aec3-97082800a027 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:45.144117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9cc4cb3a-43cf-4211-aec3-97082800a027 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:45.151395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9cc4cb3a-43cf-4211-aec3-97082800a027 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1089 microversion: 2.1 time: 0.101129 Sep 01 00:31:45.152359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 124/245] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:45 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1089 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:45.186438 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:45.194779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:45.196197 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:45.197545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b1e48969-708f-4a6a-9bc4-02cb8669e9e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.273232 Sep 01 00:31:45.198243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 122/246] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:44 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:31:45.378493 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:45.379551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:45.387932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:45.388823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:45.389739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:45.390952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:45.392290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:45.393045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:45.557696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:45.577591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fee49590-fc6d-43e7-a1ee-a50b3571bece tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.203947 Sep 01 00:31:45.579020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 125/247] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:45 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:46.175532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:46.176089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:46.187400 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:46.187997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:46.188782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:46.189749 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:46.190764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:46.191367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:46.221719 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:46.223051 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:46.238659 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:46.241134 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:46.241586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:46.242317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:46.242766 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:46.246376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:46.287850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:46.307757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2bc1e090-ec1a-4ade-b847-a7970f681eb4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1187 microversion: 2.1 time: 0.136307 Sep 01 00:31:46.308343 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 123/248] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:46 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1187 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:46.408665 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:46.419386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:46.421582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:46.423582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c2bd834d-43aa-4184-9ea6-476d3d01738c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.206389 Sep 01 00:31:46.439208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 126/249] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:46 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:46.623031 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:46.623643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:46.634209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:46.634930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:46.635539 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:46.636387 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:46.637549 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:46.637979 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:46.867166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:46.878231 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e1414304-5b94-4d80-8be1-4f8c8532dc73 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.259533 Sep 01 00:31:46.880185 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 124/250] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:46 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:47.332299 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:47.334013 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:47.345436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:47.346593 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:47.347186 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:47.348821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:47.349352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:47.349984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:47.452262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:47.454320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:47.454815 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:47.467531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:47.471828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:47.472685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:47.473759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:47.474600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:47.475854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:47.478097 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6aaa2144-02b8-4698-b4ce-c94a44f9ed01 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1205 microversion: 2.1 time: 0.150784 Sep 01 00:31:47.478957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 127/251] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:47 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1205 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:47.644744 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:47.654414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:47.656352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:47.658087 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-297483b6-ce51-4b09-a2d1-7f7d7d0252aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.211835 Sep 01 00:31:47.672666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 125/252] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:47 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:31:47.900865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:47.901785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:47.919344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:47.920081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:47.920668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:47.921521 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:47.922139 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:47.922672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:48.101993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:48.112247 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9c142fea-a979-48e7-b046-6d590f487166 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.216352 Sep 01 00:31:48.113289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 128/253] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:47 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:48.502427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:48.504998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:48.513530 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:48.514784 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:48.515541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:48.516821 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:48.517428 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:48.517851 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:48.682758 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:48.684269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:48.691932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:48.701155 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-09145c76-cd5c-4de5-b8bd-d2fe6e525b29 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1273 microversion: 2.1 time: 0.203595 Sep 01 00:31:48.718333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:48.719088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 126/254] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:48 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1273 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:48.719776 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:48.720383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:48.721129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:48.721733 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:48.722147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:49.046249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:49.056204 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:49.058491 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:49.060429 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5ed06517-359d-4ae9-bbee-c51a1e29fdd5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.382223 Sep 01 00:31:49.061508 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 129/255] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:48 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:31:49.135168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:49.136114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:49.143531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:49.144015 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:49.144687 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:49.145555 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:49.146148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:49.146719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:49.324012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:49.338966 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-60dc449e-7b73-4624-bbb1-8fe383ce02a2 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.207440 Sep 01 00:31:49.340468 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 127/256] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:49 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:49.451301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-b768fb8c-cd14-4572-b174-69ebc4d36716 req-1671c141-4f71-44aa-836f-0edc308f990a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:49.462600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b768fb8c-cd14-4572-b174-69ebc4d36716 req-1671c141-4f71-44aa-836f-0edc308f990a service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:49.463081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b768fb8c-cd14-4572-b174-69ebc4d36716 req-1671c141-4f71-44aa-836f-0edc308f990a service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:49.463504 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b768fb8c-cd14-4572-b174-69ebc4d36716 req-1671c141-4f71-44aa-836f-0edc308f990a service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:49.477383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-b768fb8c-cd14-4572-b174-69ebc4d36716 req-1671c141-4f71-44aa-836f-0edc308f990a service nova] Creating event network-changed:7e1bd795-ba93-4500-a63a-3a150fd97453 for instance 12865e9d-801f-4fc9-a160-3628da11fe30 on hv-cinder-82002 Sep 01 00:31:49.482436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-b768fb8c-cd14-4572-b174-69ebc4d36716 req-1671c141-4f71-44aa-836f-0edc308f990a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037588 Sep 01 00:31:49.483063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 130/257] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:31:49.729605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:49.730392 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:49.742264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:49.743153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:49.743967 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:49.745186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:49.745859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:49.747044 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:49.914242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:49.923446 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fa48007d-70b1-460a-ac4a-554fd45fb832 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1273 microversion: 2.1 time: 0.200470 Sep 01 00:31:49.928575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 128/258] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:49 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1273 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:50.075735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8ee148b9-0821-4d26-a8ab-d37dd2a20114 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:50.085119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:50.086275 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:50.108099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.108782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.109314 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ee148b9-0821-4d26-a8ab-d37dd2a20114 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.110062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ee148b9-0821-4d26-a8ab-d37dd2a20114 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.110503 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ee148b9-0821-4d26-a8ab-d37dd2a20114 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.111040 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.113797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.116593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.117488 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.210611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8ee148b9-0821-4d26-a8ab-d37dd2a20114 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Going to try to stop instance {{(pid=132498) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 00:31:50.283925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:50.310573 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8ee148b9-0821-4d26-a8ab-d37dd2a20114 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action" status: 202 len: 0 microversion: 2.1 time: 0.239796 Sep 01 00:31:50.311978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 131/259] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:31:50 2022] POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:31:50.335990 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:50.337266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:50.349342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.350584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.351282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.352180 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.352871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.353485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.440270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:50.466289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:50.470785 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:50.477137 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-87ddd67f-b6e7-4b07-9567-3020320c5909 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.396472 Sep 01 00:31:50.479252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 129/260] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:50 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:50.496848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:50.497469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:50.508371 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.509417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.510007 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.510948 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.512401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.514542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.572713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:50.583404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b76632d8-80a2-4b4e-803c-0ca100946db4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.264677 Sep 01 00:31:50.584896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 132/261] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:50 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:50.715726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:50.728041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7dc0e63e-286b-4ff8-b973-cfbc4f299970 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.246976 Sep 01 00:31:50.728771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 130/262] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:50 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:50.946029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:50.946973 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:50.954430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.955001 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.955657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:50.956958 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:50.957569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:50.958000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.152406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:51.162141 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0d5fc0ee-3b33-4484-afd2-0e76c9034d2a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.221111 Sep 01 00:31:51.163264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 133/263] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:50 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:51.503417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:51.504043 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:51.511150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.512521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.513143 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.514070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.514531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.514957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.608169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:51.608877 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:51.627379 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.627882 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.628319 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.630147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.630612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.631040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.689263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:51.701071 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:51.702874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:51.704136 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d0500d99-be15-4574-8cd3-cd22216e3768 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.204894 Sep 01 00:31:51.704941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 131/264] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:51 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:51.758150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:51.758822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:51.765085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.765568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.766001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.766695 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.767145 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.767560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.803753 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:51.814126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-200f8a0d-a604-4ae2-8587-faecef519485 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.211814 Sep 01 00:31:51.814713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 134/265] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:51 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:51.918865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:51.927430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c1119e13-936c-4c5b-a091-391d497320ca tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1501 microversion: 2.1 time: 0.181465 Sep 01 00:31:51.928599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 132/266] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:51 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1501 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:51.948426 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0b67590c-903e-454e-8d05-8bcdce37dda1"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:51.950943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:51.957564 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.958043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.958473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.959168 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:51.959612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:51.960031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:51.990671 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] HTTP exception thrown: Cannot 'attach_volume' instance f5dc5608-df5a-4c41-9d46-fd161e18e075 while it is in vm_state rescued Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Request method failure captured: Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/os-volume_attachments HTTP/1.1 Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 74 Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0GhEyvJ_PVtDwlrtoFX0jra6o3AW0UK3jQtMkVWq0CQXyAidUcnuMIcctNMm9_7xLitd3wLW3t31O_nGWArVIZv0ClA0s2dpWM-MpuwTu0duQUFEWKQXRR0_gXq-7E3X9iUoPQdHus1afQFGu2xNIheKMlEcOaFv5lHPugiRYNqkA Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:31:51.992304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}] Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: a6f08eaef2d149a9b0236d4bcbe03a92 Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {"volumeAttachment": {"volumeId": "0b67590c-903e-454e-8d05-8bcdce37dda1"}} Sep 01 00:31:51.993677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Cannot 'attach_volume' instance f5dc5608-df5a-4c41-9d46-fd161e18e075 while it is in vm_state rescued Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'server_id': 'f5dc5608-df5a-4c41-9d46-fd161e18e075', 'body': {'volumeAttachment': {'volumeId': '0b67590c-903e-454e-8d05-8bcdce37dda1'}}} Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:31:51.994413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance f5dc5608-df5a-4c41-9d46-fd161e18e075 while it is in vm_state rescued Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:31:51.995551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance f5dc5608-df5a-4c41-9d46-fd161e18e075 while it is in vm_state rescued Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Returning 409 to user: Cannot 'attach_volume' instance f5dc5608-df5a-4c41-9d46-fd161e18e075 while it is in vm_state rescued {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-784b759b-1ceb-4615-a1c0-d80d99c8c974 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.049340 Sep 01 00:31:51.996727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 135/267] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:31:51 2022] POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/os-volume_attachments => generated 152 bytes in 50 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 00:31:52.003299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:52.004250 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:52.013137 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.014138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.014853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.015814 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.016335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.017005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.099478 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-783600e0-92ac-42ab-8e48-e941547a9bec tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/action" status: 202 len: 0 microversion: 2.1 time: 0.099741 Sep 01 00:31:52.100383 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 133/268] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:31:51 2022] POST /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:31:52.111108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:52.111835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:52.120291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.121166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.121779 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.122468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.122949 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.123462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.191737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:52.192438 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:52.203312 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.203813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.204250 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.205003 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.205486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.206918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.400798 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:52.414265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bc527642-8ddb-4c09-9ab6-80cb15d5d36f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.226870 Sep 01 00:31:52.426630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 134/269] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:52 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:52.443987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:52.453091 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-561bbd6b-9405-4893-93bc-4970209f359a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1509 microversion: 2.1 time: 0.347466 Sep 01 00:31:52.453673 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 136/270] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:52 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1509 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:52.737628 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:52.738280 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:52.762563 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.763256 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.763780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.764923 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.765436 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.765850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.841274 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:52.845821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:52.853406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.854002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.854852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.856124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:52.856759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:52.857618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:52.951733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:52.963791 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:52.966206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:52.968130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2ff5aaa7-58cb-4b4c-baa9-d4bb4a8be40f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.241517 Sep 01 00:31:52.969300 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 135/271] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:52 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:53.015447 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:53.024385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bc7732eb-7235-4b4d-acc2-cac12a05b5a7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.189334 Sep 01 00:31:53.025304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 137/272] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:52 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:53.435274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:53.435984 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:53.445059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:53.445486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:53.446003 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:53.446820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:53.447276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:53.447580 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:53.475648 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:53.476327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:53.493911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:53.494542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:53.494844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:53.495741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:53.496337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:53.503484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:53.600875 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:53.609870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5b677475-5a5d-4825-a76c-eb04e242f35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.178400 Sep 01 00:31:53.623420 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 136/273] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:53 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:53.695761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:53.708393 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4ffe2942-0fea-4c1b-b5b7-e95564420b53 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1509 microversion: 2.1 time: 0.236762 Sep 01 00:31:53.709442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 138/274] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:53 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1509 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:53.997520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:53.999505 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:54.009963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.010483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.010863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.012366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.013194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.013588 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.046607 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:54.047817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:54.057874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.059124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.059752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.060666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.061471 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.062337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.219815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:54.229518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:54.232457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-041ce3a1-24cb-4fc6-ad1e-06887a10a9fe tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.189873 Sep 01 00:31:54.233393 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 139/275] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:54 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:54.236880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:54.251045 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:54.253730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:54.255278 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e004b490-405f-484a-9861-6cf987299fc1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.263479 Sep 01 00:31:54.259041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 137/276] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:53 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:54.631584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:54.632180 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:54.639581 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.640109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.641129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.641818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.642265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.642689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.665499 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:54.731680 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:54.732309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:54.739352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.739682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.740171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.740833 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:54.741281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:54.741700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:54.845693 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:54.858206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8ad0ac52-e754-4eaa-80b4-98d7f24adcde tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.230716 Sep 01 00:31:54.865099 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 140/277] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:54 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:54.939294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:54.947789 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d3c428b2-bba9-42dd-a657-dab39e0f448d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1509 microversion: 2.1 time: 0.220040 Sep 01 00:31:54.949527 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 138/278] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:54 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1509 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:55.267234 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:55.268159 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:55.270599 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=8 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:55.282629 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:55.284004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:55.284826 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.285376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.285813 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.286510 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.286956 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.287403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.294821 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.297772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.298489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.299415 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.300063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.300782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.483924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:55.498164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:55.501949 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:55.503586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:55.504927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fe0d01b7-4ad5-433f-81e2-6ea06b8b3939 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.226237 Sep 01 00:31:55.512818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4e8aafa0-e217-4e04-ae31-994f7add3873 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.249559 Sep 01 00:31:55.514397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 141/279] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:55 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:55.521845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 139/280] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:55 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:55.887645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:55.888677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:55.897450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.897906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.898343 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.899050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.899502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.899925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.971319 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:55.972166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:55.987722 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.988122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.988585 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:55.989304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:55.989758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:55.990181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:56.092938 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:56.103910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c7dba6e1-338d-432f-8ca1-1632a86e7ad6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.217439 Sep 01 00:31:56.121748 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 142/281] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:55 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:56.258853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:56.274012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cb5a056e-1a24-4310-b0e3-cc8c953f7c30 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1515 microversion: 2.1 time: 0.306272 Sep 01 00:31:56.274881 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 140/282] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:55 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1515 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:56.533750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:56.534373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:56.535779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:56.536406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:56.537121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:56.538862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=86 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:31:56.548895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:56.552414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:56.554628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:56.555133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:56.555992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:56.556796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:56.557377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:56.557832 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:56.560473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:56.561382 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:56.562017 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:56.562974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:56.775121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:56.787313 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d3d0f179-9fa4-4b17-b13c-ae1206ba7837 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.255822 Sep 01 00:31:56.788570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 141/283] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:56 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:56.797392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:56.807287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:56.809586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:56.810757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-42c225e3-9b04-4a9a-b282-4b2737ea1fa1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.284632 Sep 01 00:31:56.811492 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 143/284] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:56 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:31:57.128632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:57.129232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:57.135476 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:57.136142 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:57.137321 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:57.138163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:57.138758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:57.139325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:57.289410 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:57.299167 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c696ead6-befb-4aea-b8c2-9e492e6ceb63 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.174004 Sep 01 00:31:57.308895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 142/285] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:57 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:57.810132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:57.811716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:57.818299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-86a221c0-506d-42d1-8ae6-22819292e711 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'create', calling method: .version_select at 0x7fcadffcd160>, body: {"keypair": {"name": "tempest-keypair-646029963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI/gVXJNqs7ULqs0CdTTtDACUTfiiMwk/vXMTuarNroHp0ZBHP77MdEQsMdsIcja5icNatkTuVjy51vGY3vsjFVBFb5hldblBhcApxLIkFINoTsHThox10KR7zWR13wArQ=="}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:31:57.820043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:57.820867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:57.821592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:57.822423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:57.822999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:57.823640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:57.839666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-86a221c0-506d-42d1-8ae6-22819292e711 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:31:57.844708 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-86a221c0-506d-42d1-8ae6-22819292e711 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for user a6f08eaef2d149a9b0236d4bcbe03a92 and project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:31:57.894400 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-86a221c0-506d-42d1-8ae6-22819292e711 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.079857 Sep 01 00:31:57.895188 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 143/286] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:31:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:31:57.900602 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:57.901613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:57.908217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:57.911716 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:57.912549 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:57.913387 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:57.914836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:57.915486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:58.111769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:58.121439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a2df7ed9-b8e7-44ef-a574-641f20b4a030 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.315756 Sep 01 00:31:58.123029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 144/287] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:57 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:58.318524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:58.325854 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:58.326633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:58.329685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:58.331678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:58.333726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4b13adba-7b61-494c-924a-6b519d62408c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.437294 Sep 01 00:31:58.334800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 144/288] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:57 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:58.358105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:58.359853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:58.360565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:58.361760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:58.362842 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:58.363451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:58.573415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:58.586669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ae74205f-37db-4a9d-ae80-9cec444a0965 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.270432 Sep 01 00:31:58.587256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 145/289] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:58 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:31:59.143541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:59.145429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:59.153573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:59.154209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:59.154778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:59.155701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:59.156159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:59.156691 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:59.300723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:59.309939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7db4a41f-050c-4540-9be7-471bee9d4b92 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.170120 Sep 01 00:31:59.310766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 145/290] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:59 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:59.361229 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:59.362011 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:59.369178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:59.369650 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:59.370081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:59.371315 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:59.371797 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:59.372254 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:59.609822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:31:59.610461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:31:59.616513 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:59.616955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:59.617397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:59.618096 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:31:59.618559 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:31:59.618983 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:31:59.749781 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:59.758125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:59.759700 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:59.761915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:31:59.763418 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-05fef411-a519-4993-a7f6-20ae3726374e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.406299 Sep 01 00:31:59.764389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 146/291] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:31:59 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:31:59.770180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f55c3f1b-1208-4068-b69f-2cf024b7a836 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.164140 Sep 01 00:31:59.770808 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:31:59 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:31:59.944715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-526488280", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7dac0ef3-49f5-4c90-b2ad-1bb41b9f1f0b"}], "security_groups": [{"name": "tempest-securitygroup--910630475"}], "key_name": "tempest-keypair-646029963", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:00.047262 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] validate_networks() for [('7dac0ef3-49f5-4c90-b2ad-1bb41b9f1f0b', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:32:00.333664 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:00.334366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:00.341035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.341526 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.341962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.342662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.343115 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.343539 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.422265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:32:00.422770 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:32:00.423369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:32:00.423624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:32:00.424042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:32:00.433988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.434470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.434937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.435667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.436109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.436554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.454245 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:32:00.458691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Getting quotas for user a6f08eaef2d149a9b0236d4bcbe03a92 and project 64e86923fd7b42cfaf18408210d4f6d7. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:32:00.470045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:32:00.472358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:32:00.477292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:00.487876 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bfc58bf6-1428-413a-afbf-c3f936f05df2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.158174 Sep 01 00:32:00.488648 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 147/293] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:00 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:00.524371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-068d25ab-d158-4d80-ab02-2eb839380989 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.583805 Sep 01 00:32:00.525290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 147/294] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:31:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:32:00.536484 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b7a5fff3-dc42-4228-8982-036efe24b403 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:00.537188 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b7a5fff3-dc42-4228-8982-036efe24b403 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:00.608477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b7a5fff3-dc42-4228-8982-036efe24b403 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:00.616405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b7a5fff3-dc42-4228-8982-036efe24b403 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1244 microversion: 2.1 time: 0.084213 Sep 01 00:32:00.617366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 148/295] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:00 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:00.788870 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:00.789483 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:00.793932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:00.795243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:00.798034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.799084 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.799744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.801073 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.802427 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.803008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.806358 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.808131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.808131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:00.809022 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:00.809630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:00.810153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:01.033553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:01.059378 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:01.061996 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:01.063806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d062bdff-328c-451a-b1c5-12cd716ba326 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1745 microversion: 2.20 time: 0.280905 Sep 01 00:32:01.065003 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 148/296] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:00 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1745 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:01.066190 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:01.072313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-26a8d146-7a9b-46a4-b4bd-af1a94d6a0e3 req-ce10d757-c948-4e80-874c-6e49f488b445 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "name": "network-vif-plugged", "status": "completed", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:01.086992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-53a5f227-ccac-4117-bdb9-890f81bf0d7d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.298309 Sep 01 00:32:01.087928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 149/297] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:00 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:01.097381 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-26a8d146-7a9b-46a4-b4bd-af1a94d6a0e3 req-ce10d757-c948-4e80-874c-6e49f488b445 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:01.098121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-26a8d146-7a9b-46a4-b4bd-af1a94d6a0e3 req-ce10d757-c948-4e80-874c-6e49f488b445 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:01.098700 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-26a8d146-7a9b-46a4-b4bd-af1a94d6a0e3 req-ce10d757-c948-4e80-874c-6e49f488b445 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:01.114507 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:01.119192 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-26a8d146-7a9b-46a4-b4bd-af1a94d6a0e3 req-ce10d757-c948-4e80-874c-6e49f488b445 service nova] Creating event network-vif-plugged:7e1bd795-ba93-4500-a63a-3a150fd97453 for instance 12865e9d-801f-4fc9-a160-3628da11fe30 on hv-cinder-82002 Sep 01 00:32:01.128890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-26a8d146-7a9b-46a4-b4bd-af1a94d6a0e3 req-ce10d757-c948-4e80-874c-6e49f488b445 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061129 Sep 01 00:32:01.129609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 149/298] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:01.513347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:01.514216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:01.521273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:01.521833 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:01.522339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:01.523138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:01.523668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:01.524177 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:01.639744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:01.640596 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:01.648880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:01.649426 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:01.649861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:01.650561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:01.651011 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:01.651461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:01.670900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:01.679270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1ef45ba1-a27c-4735-abed-f5bb5c487e4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.173703 Sep 01 00:32:01.679834 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 150/299] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:01 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:01.726895 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:01.736875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3302511c-6e38-411b-af36-5529cff2f53d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1296 microversion: 2.1 time: 0.102749 Sep 01 00:32:01.740917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 150/300] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:01 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:02.087506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:02.088110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:02.094917 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.095447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.095888 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.096639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.097094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.097517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.109588 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:02.110387 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:02.116631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.117054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.117486 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.118191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.118630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.119049 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.230315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:02.239632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:02.241089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:02.243058 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5a1339e1-4ad9-4eb6-a856-012ec2786d77 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1745 microversion: 2.20 time: 0.159327 Sep 01 00:32:02.243805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 151/301] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:02 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:02.271681 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:02.281849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a0b33ee2-c74a-42d5-8fa1-46c479f7e0e3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1261 microversion: 2.1 time: 0.177412 Sep 01 00:32:02.282423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 151/302] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:02 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:02.705996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:02.707298 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:02.715645 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.716303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.717054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.718660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.719964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.721200 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.763385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:02.764038 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:02.780996 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.781897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.782497 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.783350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:02.783978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:02.784567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:02.899844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:02.908834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-631f8198-fad4-4558-b54a-32723d0d1a35 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1304 microversion: 2.1 time: 0.150964 Sep 01 00:32:02.909875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 152/303] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:02 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1304 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:02.954405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:02.967008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-52bc2b39-00e0-4606-b4ad-26f4ee565d89 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.264916 Sep 01 00:32:02.967911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 152/304] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:02 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:03.147715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-68afa7dd-2d65-44ea-a43a-cd1f97f5c7c1 req-94921694-40c1-42d1-bb62-1edbd8c2ce52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "name": "network-vif-plugged", "status": "completed", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:03.161666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-68afa7dd-2d65-44ea-a43a-cd1f97f5c7c1 req-94921694-40c1-42d1-bb62-1edbd8c2ce52 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.162145 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-68afa7dd-2d65-44ea-a43a-cd1f97f5c7c1 req-94921694-40c1-42d1-bb62-1edbd8c2ce52 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.162576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-68afa7dd-2d65-44ea-a43a-cd1f97f5c7c1 req-94921694-40c1-42d1-bb62-1edbd8c2ce52 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.176831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-68afa7dd-2d65-44ea-a43a-cd1f97f5c7c1 req-94921694-40c1-42d1-bb62-1edbd8c2ce52 service nova] Creating event network-vif-plugged:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:32:03.182261 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-68afa7dd-2d65-44ea-a43a-cd1f97f5c7c1 req-94921694-40c1-42d1-bb62-1edbd8c2ce52 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040788 Sep 01 00:32:03.183968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 153/305] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:03.266172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:03.266806 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:03.273050 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.273768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.274490 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.275372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.276005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.276712 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.303688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:03.304752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:03.312994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.313493 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.313930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.314675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.315131 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.315561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.440422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:03.449908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:03.451823 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:03.453036 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-85f23c3b-5f59-484e-824c-a544f9291d2f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1745 microversion: 2.20 time: 0.190824 Sep 01 00:32:03.453590 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 153/306] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:03 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:03.492200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:03.501049 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0f03da9e-632b-4b2f-a4fd-6582220a3ad4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1445 microversion: 2.1 time: 0.201822 Sep 01 00:32:03.501846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 154/307] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:03 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1445 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:03.524614 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:03.525398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:03.532427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.533028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.533529 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.534221 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.534829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.535405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.692939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:03.703164 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ffac20b8-cc05-4973-8e78-593b9ffce35f tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1445 microversion: 2.1 time: 0.183457 Sep 01 00:32:03.703840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 154/308] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:03 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1445 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:03.932297 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:03.932969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:03.943037 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.947118 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.947705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.948540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:03.950802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:03.951417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:03.989543 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:03.990010 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:04.004697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:04.005466 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:04.006056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:04.007019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:04.007406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:04.007834 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:04.125263 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:04.150741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8a8bb98d-557f-4bed-ba38-575dc5664577 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1302 microversion: 2.1 time: 0.223870 Sep 01 00:32:04.152745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 155/309] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:03 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1302 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:04.165626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:04.175211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bcb85494-5f17-4a43-a2d0-f88e77d320d4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.190169 Sep 01 00:32:04.175985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 155/310] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:03 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:04.477357 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:04.477971 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:04.494991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:04.497342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:04.503898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:04.506707 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:04.508113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:04.508932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:04.896785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:04.909343 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:04.915389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:04.916759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f374dc8a-6f18-43cf-991b-75279f558c04 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.443174 Sep 01 00:32:04.926476 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 156/311] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:04 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:05.173597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:05.174913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:05.181140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:05.181639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:05.182078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:05.182824 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:05.194903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:05.197143 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:05.197282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:05.197783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:05.207220 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:05.209269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:05.213447 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:05.214854 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:05.215467 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:05.216064 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:05.263818 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=100 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:05.460382 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:05.471625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e8654763-9857-40e2-99bf-d8bbe451aa1a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.301798 Sep 01 00:32:05.477449 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 156/312] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:05 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:05.784062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:05.795500 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5a2cae4a-7222-490c-8fc3-fad17707b0f2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1725 microversion: 2.1 time: 0.602061 Sep 01 00:32:05.809736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 157/313] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:05 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1725 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:05.950557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:05.951332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:05.958180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:05.959234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:05.959867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:05.960838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:05.961613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:05.962226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:06.141660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:06.153473 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:06.155296 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:06.156896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bfaed65b-a22b-4ccb-8caf-c8924a23f6b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.210768 Sep 01 00:32:06.157690 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 157/314] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:05 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:06.366126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-917141523", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:06.380633 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-f6719ecd-dbcd-46a3-a2d5-aafc30b5885a req-0fe5f1d8-7f40-4480-8361-c34c8c55b6eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf8d128-7684-4263-babf-222cc0beae80", "tag": "54ed4609-29d2-46df-968c-532a898d8333"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:06.410995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f6719ecd-dbcd-46a3-a2d5-aafc30b5885a req-0fe5f1d8-7f40-4480-8361-c34c8c55b6eb service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:06.428744 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f6719ecd-dbcd-46a3-a2d5-aafc30b5885a req-0fe5f1d8-7f40-4480-8361-c34c8c55b6eb service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:06.429309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f6719ecd-dbcd-46a3-a2d5-aafc30b5885a req-0fe5f1d8-7f40-4480-8361-c34c8c55b6eb service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:06.452960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-f6719ecd-dbcd-46a3-a2d5-aafc30b5885a req-0fe5f1d8-7f40-4480-8361-c34c8c55b6eb service nova] Creating event network-changed:54ed4609-29d2-46df-968c-532a898d8333 for instance abf8d128-7684-4263-babf-222cc0beae80 on hv-cinder-82002 Sep 01 00:32:06.463534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-f6719ecd-dbcd-46a3-a2d5-aafc30b5885a req-0fe5f1d8-7f40-4480-8361-c34c8c55b6eb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085872 Sep 01 00:32:06.465988 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 158/315] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:06.501626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:06.502734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:06.512895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:06.513681 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:06.514432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:06.515355 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:06.516035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:06.522795 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:06.576626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] validate_networks() for None {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:32:06.740555 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:06.751103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e9613587-9392-4c18-8c00-a90e1c84f60c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.253972 Sep 01 00:32:06.752268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 159/316] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:06 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:06.821964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:06.825013 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:06.833201 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:06.833997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:06.834591 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:06.835485 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:06.836145 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:06.837016 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.032404 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:07.043537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6d3471d7-0cba-4370-b46d-8ce3c0c386d7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1702 microversion: 2.1 time: 0.225687 Sep 01 00:32:07.058219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 160/317] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:06 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1702 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:07.063893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-eb019e7c-0fb8-45b4-bed5-8d95c7363fd3 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:07.070480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb019e7c-0fb8-45b4-bed5-8d95c7363fd3 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.070999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb019e7c-0fb8-45b4-bed5-8d95c7363fd3 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.071415 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb019e7c-0fb8-45b4-bed5-8d95c7363fd3 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.141836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-eb019e7c-0fb8-45b4-bed5-8d95c7363fd3 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Going to try to start instance {{(pid=132496) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 00:32:07.203890 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-eb019e7c-0fb8-45b4-bed5-8d95c7363fd3 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action" status: 202 len: 0 microversion: 2.1 time: 0.143841 Sep 01 00:32:07.208758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 161/318] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:32:07 2022] POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:32:07.214403 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:07.215194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:07.223295 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.224439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.225055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.226429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.228532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.228532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.240762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:32:07.241442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:32:07.242272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:32:07.245440 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:32:07.246609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:32:07.278301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.280100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.283047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.284146 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.284955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.288547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.340941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Getting quotas for project 3747df9616604e22826b8f308eac57e3. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:32:07.351780 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Getting quotas for user 04edb638af8c43a78db9ef629154df83 and project 3747df9616604e22826b8f308eac57e3. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:32:07.387367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:32:07.395342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:32:07.450939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:07.466226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:07.467888 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:07.470946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e25e4d6a-4af9-47da-a6e5-ba1828176e42 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111965 Sep 01 00:32:07.471247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f9630210-b85c-4ced-ba5a-17de1433bdbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.261226 Sep 01 00:32:07.477756 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 162/319] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:07 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:07.478451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 158/320] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:32:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:32:07.485430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:07.486050 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:07.494206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fbf901ba-6db4-4227-828c-f8cd429e27df tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:07.498814 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.499315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.499757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.500465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.500871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fbf901ba-6db4-4227-828c-f8cd429e27df tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:07.500992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.501369 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.619269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fbf901ba-6db4-4227-828c-f8cd429e27df tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:07.630030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fbf901ba-6db4-4227-828c-f8cd429e27df tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1214 microversion: 2.1 time: 0.150177 Sep 01 00:32:07.632396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 159/321] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:07 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:07.683406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:07.696320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-70c2e294-bb80-444b-9d78-8b0f77472052 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1711 microversion: 2.1 time: 0.220374 Sep 01 00:32:07.697123 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 163/322] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:07 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1711 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:07.773688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:07.774303 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:07.782130 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.783366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.784891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:07.786707 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:07.787518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:07.789031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.072354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:08.084202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3a09e515-6a46-4f18-984f-951c77ff3841 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.314605 Sep 01 00:32:08.084841 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 160/323] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:07 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:08.482952 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-8178b02c-ada7-414a-a28b-80a9e0ea4fdc req-ec665f75-d8ea-4708-a1d6-892e6592867d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:08.492705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-8178b02c-ada7-414a-a28b-80a9e0ea4fdc req-ec665f75-d8ea-4708-a1d6-892e6592867d service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.493107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-8178b02c-ada7-414a-a28b-80a9e0ea4fdc req-ec665f75-d8ea-4708-a1d6-892e6592867d service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.493544 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-8178b02c-ada7-414a-a28b-80a9e0ea4fdc req-ec665f75-d8ea-4708-a1d6-892e6592867d service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.496731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:08.498489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:08.505701 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.506194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-8178b02c-ada7-414a-a28b-80a9e0ea4fdc req-ec665f75-d8ea-4708-a1d6-892e6592867d service nova] Creating event network-changed:7e1bd795-ba93-4500-a63a-3a150fd97453 for instance 12865e9d-801f-4fc9-a160-3628da11fe30 on hv-cinder-82002 Sep 01 00:32:08.507099 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.507873 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.511790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.512974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-8178b02c-ada7-414a-a28b-80a9e0ea4fdc req-ec665f75-d8ea-4708-a1d6-892e6592867d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035047 Sep 01 00:32:08.513241 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.513907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 164/324] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:08.514105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.655551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:08.657122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:08.670085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.670866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.671472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.672393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.673028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.674010 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.700828 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:08.719527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:08.721010 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:08.725451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2513d2e4-c2d3-4e38-9db1-772eaea24718 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.234635 Sep 01 00:32:08.726360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 161/325] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:08 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:08.754296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:08.757235 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:08.769333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.770421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.770940 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.772203 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:08.772763 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:08.773858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:08.781084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:08.789895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-81c443da-a018-4b65-a3c3-658ab5efc9d6 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1218 microversion: 2.1 time: 0.138788 Sep 01 00:32:08.793359 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 165/326] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:08 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1218 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:09.182282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:09.183703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:09.210653 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:09.210653 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:09.211119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:09.211522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:09.217210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:09.236299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:09.872232 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:09.881361 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b9c3aa31-9487-4d39-8cf3-bec56982a4ff tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1711 microversion: 2.1 time: 1.153872 Sep 01 00:32:09.889702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 162/327] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:08 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1711 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:09.892445 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:09.905505 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:09.913810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-01871ec8-affb-49da-917f-07bad92d2d3e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.740337 Sep 01 00:32:09.915094 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:09.936557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 166/328] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:09 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:09.936557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:09.936557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:09.942281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:09.942780 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:09.943412 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:09.944286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:09.944928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:09.945498 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:09.955793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:09.956507 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:09.957059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:09.958444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:09.958985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:09.960936 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:10.054769 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:10.068667 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3ccbfd78-e76f-4341-83c2-d3b7c262f1ff tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1266 microversion: 2.1 time: 0.140443 Sep 01 00:32:10.069622 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 167/329] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:09 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1266 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:10.629683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:10.640553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:10.648565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:10.649964 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f1d912d0-3aa5-4e03-9903-53b0b8f7ff4f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.756793 Sep 01 00:32:10.653288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 163/330] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:09 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:10.914170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:10.915647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:10.935112 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:10.946892 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:10.947745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:10.949039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:10.950100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:10.950831 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:10.951443 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:10.956780 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:10.957391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:10.971282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:10.971815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:10.972251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:10.972984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:10.973435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:10.973965 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:11.244807 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:11.257685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:11.267728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3a515b3e-e519-40f4-bcb2-cb5d587a7c17 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.316298 Sep 01 00:32:11.269791 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 164/331] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:10 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:11.272366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4466e327-ef58-4f57-ba94-fe13122fb5eb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1711 microversion: 2.1 time: 0.363925 Sep 01 00:32:11.276600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:11.277636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:11.286007 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:11.286775 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:11.287224 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 168/332] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:10 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1711 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:11.287576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:11.288919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:11.289755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:11.290476 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:11.408334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:11.420928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dd2c1efc-653d-4ce8-9573-a49cab336d9a tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1272 microversion: 2.1 time: 0.149192 Sep 01 00:32:11.422542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 165/333] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:11 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1272 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:11.494720 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-3763ff57-1e1b-49d4-a49e-0eb349a96165 req-88396dd6-b2dc-4d72-b6af-7bf487514547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf8d128-7684-4263-babf-222cc0beae80", "name": "network-vif-plugged", "status": "completed", "tag": "54ed4609-29d2-46df-968c-532a898d8333"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:11.509759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-3763ff57-1e1b-49d4-a49e-0eb349a96165 req-88396dd6-b2dc-4d72-b6af-7bf487514547 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:11.515395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-3763ff57-1e1b-49d4-a49e-0eb349a96165 req-88396dd6-b2dc-4d72-b6af-7bf487514547 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:11.516132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-3763ff57-1e1b-49d4-a49e-0eb349a96165 req-88396dd6-b2dc-4d72-b6af-7bf487514547 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:11.540214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-3763ff57-1e1b-49d4-a49e-0eb349a96165 req-88396dd6-b2dc-4d72-b6af-7bf487514547 service nova] Creating event network-vif-plugged:54ed4609-29d2-46df-968c-532a898d8333 for instance abf8d128-7684-4263-babf-222cc0beae80 on hv-cinder-82002 Sep 01 00:32:11.552402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-3763ff57-1e1b-49d4-a49e-0eb349a96165 req-88396dd6-b2dc-4d72-b6af-7bf487514547 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061352 Sep 01 00:32:11.553307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 169/334] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:11.680775 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:11.682279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:11.695409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:11.697536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:11.699991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:11.700869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:11.703602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:11.704118 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:11.895278 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:11.905949 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:11.907791 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:11.909551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fe0be8ab-37db-4041-9ffa-d6a91256df78 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.235518 Sep 01 00:32:11.910290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 166/335] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:11 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:12.292554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:12.293480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:12.293650 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:12.294190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:12.302683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.303268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.303948 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.304179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.305077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.305324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.305974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.306536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.306776 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.308369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.309313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.309799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.495917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:12.506079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ab5649b5-2c35-4747-bf2d-1150c24f68c4 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1711 microversion: 2.1 time: 0.216671 Sep 01 00:32:12.518111 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 167/336] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:12 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1711 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:12.526081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:12.529750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:12.552077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.555244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.555791 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.556613 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.557129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.560419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.612529 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:12.639770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c61cb378-0988-44a8-a777-dbcee5d8d2b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.347761 Sep 01 00:32:12.645393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 170/337] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:12 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:12.812538 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:12.816645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:12.823033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2bbeac5d-59b6-43cd-8944-15136895f630 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.302574 Sep 01 00:32:12.824112 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 168/338] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:12 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:12.936077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:12.937009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:12.943583 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.944076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.944520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:12.945752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:12.947121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:12.947772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.195830 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:13.217406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:13.222163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:13.224964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2c90dd02-d9b7-4a19-92b4-fb731fcbeee0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.293336 Sep 01 00:32:13.226302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 171/339] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:12 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:13.433715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-013deaab-b1da-4cbf-a3b9-6e68e996f46e req-7b160d77-beb1-4d8d-bf37-12657774bc50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67263881-ac3a-4855-965b-19c5b25c35c6", "tag": "979409b1-abcb-42c6-b49f-ac409f9aef9e"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:13.451064 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-013deaab-b1da-4cbf-a3b9-6e68e996f46e req-7b160d77-beb1-4d8d-bf37-12657774bc50 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.451399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-013deaab-b1da-4cbf-a3b9-6e68e996f46e req-7b160d77-beb1-4d8d-bf37-12657774bc50 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.451670 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-013deaab-b1da-4cbf-a3b9-6e68e996f46e req-7b160d77-beb1-4d8d-bf37-12657774bc50 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.469249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-013deaab-b1da-4cbf-a3b9-6e68e996f46e req-7b160d77-beb1-4d8d-bf37-12657774bc50 service nova] Creating event network-changed:979409b1-abcb-42c6-b49f-ac409f9aef9e for instance 67263881-ac3a-4855-965b-19c5b25c35c6 on hv-cinder-82002 Sep 01 00:32:13.474896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-013deaab-b1da-4cbf-a3b9-6e68e996f46e req-7b160d77-beb1-4d8d-bf37-12657774bc50 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046002 Sep 01 00:32:13.475647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 169/340] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:13.541745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:13.542719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:13.551193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.551907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.552345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.553067 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.553748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.554352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.668013 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:13.669030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:13.683582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.684860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.685499 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.686502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.688083 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.688083 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.767664 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:13.785274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1bd3ec43-62c3-4b58-bd7a-ea37632f4225 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1715 microversion: 2.1 time: 0.249352 Sep 01 00:32:13.801826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 172/341] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:13 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1715 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:13.850554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:13.851667 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:13.855481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:13.865541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-432dff19-cc32-455b-8be3-141b0debaa71 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1369 microversion: 2.1 time: 0.204061 Sep 01 00:32:13.867465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.872459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.875799 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:13.878170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:13.879634 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 170/342] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:13 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1369 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:13.880840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:13.881675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:14.067330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:14.076650 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bc857bdd-01a3-4240-a27e-9d7694721114 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.230864 Sep 01 00:32:14.077611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 173/343] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:13 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:14.249034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:14.250011 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:14.256405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:14.257161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:14.257741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:14.258692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:14.259290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:14.259995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:14.418158 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:14.427677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:14.429198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:14.430347 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-39f62551-ac4e-46d2-91cd-b7ef9ee9c47f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.185905 Sep 01 00:32:14.441463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 171/344] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:14 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:14.889554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:14.890256 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:14.903669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:14.904448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:14.905088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:14.906171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:14.907510 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:14.908813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:14.913693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:15.103602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:15.107563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:15.114755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:15.115752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:15.116406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:15.117458 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:15.117572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:15.118259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:15.118913 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:15.132306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-65b4ecf2-5fd4-4867-be2a-30c434392ecc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1562 microversion: 2.1 time: 0.248568 Sep 01 00:32:15.149596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 174/345] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:14 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1562 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:15.166214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:15.167336 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:15.188916 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:15.189982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:15.189982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:15.191932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:15.192405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:15.192860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:15.337348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:15.348876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-31e07ada-4b47-4b76-b72d-7c9245772f46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.249368 Sep 01 00:32:15.368090 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f91b062c-e36c-4ec2-ba4c-5067fc950132 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.206136 Sep 01 00:32:15.369554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 175/346] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:32:15 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-interface => generated 284 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:15.373871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 172/347] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:15 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:15.455036 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:15.456856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:15.466190 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:15.466755 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:15.467259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:15.468223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:15.468777 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:15.469237 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:15.655508 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:15.663937 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:15.665422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:15.666688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-60e1c4a1-830e-4960-92dd-5aafd8db265a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.216790 Sep 01 00:32:15.680520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 176/348] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:15 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:16.394488 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:16.395883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:16.406859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:16.407482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:16.408009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:16.408835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:16.409363 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:16.409888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:16.611461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-a8f39f69-a130-4d89-9a5c-b1499eb38f40 req-e0a7eb56-0efb-4799-a0ed-71a294596ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf8d128-7684-4263-babf-222cc0beae80", "tag": "54ed4609-29d2-46df-968c-532a898d8333"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:16.628472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-a8f39f69-a130-4d89-9a5c-b1499eb38f40 req-e0a7eb56-0efb-4799-a0ed-71a294596ed3 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:16.632832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:16.633234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-a8f39f69-a130-4d89-9a5c-b1499eb38f40 req-e0a7eb56-0efb-4799-a0ed-71a294596ed3 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:16.633902 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-a8f39f69-a130-4d89-9a5c-b1499eb38f40 req-e0a7eb56-0efb-4799-a0ed-71a294596ed3 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:16.647109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-538ae1cb-0093-4bce-840b-274d995366ed tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.259781 Sep 01 00:32:16.647465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-a8f39f69-a130-4d89-9a5c-b1499eb38f40 req-e0a7eb56-0efb-4799-a0ed-71a294596ed3 service nova] Creating event network-changed:54ed4609-29d2-46df-968c-532a898d8333 for instance abf8d128-7684-4263-babf-222cc0beae80 on hv-cinder-82002 Sep 01 00:32:16.659016 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 173/349] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:16 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:16.663426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-a8f39f69-a130-4d89-9a5c-b1499eb38f40 req-e0a7eb56-0efb-4799-a0ed-71a294596ed3 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055370 Sep 01 00:32:16.664167 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 177/350] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:32:16.691617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:16.692386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:16.699862 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:16.699862 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:16.700216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:16.700986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:16.701761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:16.702191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:16.906618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:16.915728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:16.918448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:16.919878 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f4d6c09b-2dc7-4c73-897f-fd7f6e9f4b22 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1740 microversion: 2.20 time: 0.232332 Sep 01 00:32:16.925009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 174/351] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:16 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1740 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:17.671307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:17.671999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:17.678609 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:17.679289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:17.680778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:17.681860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:17.682974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:17.683565 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:17.851543 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:17.860652 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d3500c08-b316-4594-bceb-1eda1e69c589 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.194758 Sep 01 00:32:17.861342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 178/352] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:17 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:17.942671 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:17.951542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:17.954322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:17.958479 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=14 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:17.978646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:17.979280 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:17.979971 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:17.980711 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:17.981170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:17.981596 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:18.190774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:18.199702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:18.201178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:18.202360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-aff6b07b-5e54-40b9-aa10-9bff49e184db tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1722 microversion: 2.20 time: 0.263555 Sep 01 00:32:18.202923 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 175/353] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:17 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1722 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:18.882203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:18.882829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:18.889347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:18.889824 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:18.890254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:18.890961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:18.891508 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:18.891926 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:19.029271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:19.037563 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-650ff168-82e4-4946-a92c-ff25655b4b46 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.159215 Sep 01 00:32:19.038124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 179/354] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:18 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:19.225957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:19.226570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:19.233966 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:19.234457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:19.235105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:19.235817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:19.236296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:19.236762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:19.306811 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-798c957e-de47-436a-8038-94fc4daba43e req-5f1de6eb-9dc0-4673-a7b3-5d0ab00cfce8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67263881-ac3a-4855-965b-19c5b25c35c6", "name": "network-vif-plugged", "status": "completed", "tag": "979409b1-abcb-42c6-b49f-ac409f9aef9e"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:19.316942 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-798c957e-de47-436a-8038-94fc4daba43e req-5f1de6eb-9dc0-4673-a7b3-5d0ab00cfce8 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:19.317421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-798c957e-de47-436a-8038-94fc4daba43e req-5f1de6eb-9dc0-4673-a7b3-5d0ab00cfce8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:19.317944 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-798c957e-de47-436a-8038-94fc4daba43e req-5f1de6eb-9dc0-4673-a7b3-5d0ab00cfce8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:19.331440 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-798c957e-de47-436a-8038-94fc4daba43e req-5f1de6eb-9dc0-4673-a7b3-5d0ab00cfce8 service nova] Creating event network-vif-plugged:979409b1-abcb-42c6-b49f-ac409f9aef9e for instance 67263881-ac3a-4855-965b-19c5b25c35c6 on hv-cinder-82002 Sep 01 00:32:19.336360 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-798c957e-de47-436a-8038-94fc4daba43e req-5f1de6eb-9dc0-4673-a7b3-5d0ab00cfce8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033195 Sep 01 00:32:19.337182 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 180/355] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:32:19.378527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:19.387661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:19.389131 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:19.390297 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4488530c-5854-4aa2-85e4-b21c258ca92b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1722 microversion: 2.20 time: 0.168564 Sep 01 00:32:19.390854 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 176/356] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:19 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:20.059847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:20.060577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:20.067147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:20.067626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:20.068066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:20.068779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:20.069235 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:20.069655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:20.202480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:20.210325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b0fa7d2f-3779-4480-bd66-f5f9286721b3 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.155820 Sep 01 00:32:20.210884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 181/357] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:20 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:20.413518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:20.414127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:20.417028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:20.422840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:20.423320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:20.423758 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:20.424450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:20.424921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:20.425348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:20.565563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:20.574421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:20.575864 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:20.577064 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3b6a433b-33a2-4f1f-a432-61b63007847a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1725 microversion: 2.20 time: 0.167473 Sep 01 00:32:20.577615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 177/358] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:20 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:20.599759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d946fb7-0f24-4b07-915f-3089ebc5086c"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:20.602144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:20.608211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:20.608735 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:20.609170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:20.609855 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:20.610306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:20.610729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:20.896826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-13f4f1d9-8c91-4226-a166-a91a1ecb473e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.300890 Sep 01 00:32:20.897441 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 182/359] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Sep 1 00:32:20 2022] POST /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments => generated 188 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:32:21.017465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:21.018184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:21.024131 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.024646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.025079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.025800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.026251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.026672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.067661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132498) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 00:32:21.133752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-dfd3c126-98f7-49c6-8518-1871be5f81fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/action" status: 202 len: 0 microversion: 2.20 time: 0.120142 Sep 01 00:32:21.134292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 178/360] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 00:32:21 2022] POST /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:32:21.143257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:21.144389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:21.151023 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.151524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.151957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.152701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.153158 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.153582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.231888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:21.232731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:21.240450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.242363 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.242811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.243537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.243998 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.245085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.312863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:21.328940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:21.330630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:21.331796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f96d0ba4-90b2-4b58-848a-cd3d3a3116e8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1811 microversion: 2.20 time: 0.192624 Sep 01 00:32:21.332352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 183/361] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:21 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1811 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:21.360988 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-026703a2-dad5-4ca9-a413-dfe0e172f03d req-cdf03e36-62c0-4174-a471-82ba17fa4958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "name": "network-vif-unplugged", "status": "completed", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:21.372018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-026703a2-dad5-4ca9-a413-dfe0e172f03d req-cdf03e36-62c0-4174-a471-82ba17fa4958 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:21.372688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-026703a2-dad5-4ca9-a413-dfe0e172f03d req-cdf03e36-62c0-4174-a471-82ba17fa4958 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:21.373172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-026703a2-dad5-4ca9-a413-dfe0e172f03d req-cdf03e36-62c0-4174-a471-82ba17fa4958 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:21.386946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-026703a2-dad5-4ca9-a413-dfe0e172f03d req-cdf03e36-62c0-4174-a471-82ba17fa4958 service nova] Creating event network-vif-unplugged:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:32:21.394062 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-026703a2-dad5-4ca9-a413-dfe0e172f03d req-cdf03e36-62c0-4174-a471-82ba17fa4958 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038599 Sep 01 00:32:21.394847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 184/362] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:21.449413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:21.457768 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8a9222a8-3289-4da4-bce4-b5b1f4db3b20 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1314 microversion: 2.1 time: 0.230316 Sep 01 00:32:21.458328 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 179/363] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:21 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:32:22.356484 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:22.357194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:22.359115 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:22.364810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.365277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.365710 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.366401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.366850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.367273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.482858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:22.483601 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:22.494013 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.494522 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.494969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.495971 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.496640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.497197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.508294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:22.517872 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:22.520665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:22.524626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ee804ab0-8d25-4cf5-938c-6b43fba61585 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1751 microversion: 2.20 time: 0.173288 Sep 01 00:32:22.541006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 185/364] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:22 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1751 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:22.655973 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:22.663603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d8310ecd-c0f6-4b6a-be0d-203a0d130cb7 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1463 microversion: 2.1 time: 0.188334 Sep 01 00:32:22.664259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 180/365] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:22 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:22.707668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:22.708196 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:22.715077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.715564 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.715998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.716724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.717173 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.717589 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.747562 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:32:22.834496 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-657576b9-58c1-48ff-90ea-4e8bc7ca8069 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "DELETE /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 204 len: 0 microversion: 2.1 time: 0.130278 Sep 01 00:32:22.835178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 186/366] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:32:22 2022] DELETE /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:32:22.845130 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:22.845740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:22.852589 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.853101 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.853532 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.854278 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:22.855416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:22.855842 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:22.987802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:22.995681 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f772087d-7206-4eb2-a13c-0be16bfa5916 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1469 microversion: 2.1 time: 0.155441 Sep 01 00:32:22.996368 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 181/367] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:22 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:23.552077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:23.552954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:23.563502 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:23.564061 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:23.564635 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:23.565441 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:23.565962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:23.566481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:23.699853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:23.709830 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:23.711459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:23.712829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6b28f3f1-9f0a-4883-ac17-e19e378e0fc3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1753 microversion: 2.20 time: 0.165662 Sep 01 00:32:23.714105 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 187/368] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:23 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:24.017161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:24.017788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:24.024375 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:24.024888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:24.025322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:24.026275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:24.026721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:24.027173 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:24.159265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:24.166852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f35bc22a-1e11-4fc5-907a-41e2447a6458 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1469 microversion: 2.1 time: 0.153631 Sep 01 00:32:24.167412 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 182/369] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:24 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:24.737265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:24.737922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:24.744761 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:24.745482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:24.745920 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:24.746607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:24.747053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:24.747472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:24.901530 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:24.904169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:24.914191 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:24.915686 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:24.917998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7c5cd1ec-22b3-47b6-b4c1-f937cf39938e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1753 microversion: 2.20 time: 0.185074 Sep 01 00:32:24.919805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 188/370] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:24 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1753 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:25.187741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:25.188424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:25.194821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:25.195397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:25.195902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:25.196712 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:25.197238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:25.198259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:25.397175 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:25.405416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ddf44da4-c773-4373-a0d5-54f627b7bf4d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1469 microversion: 2.1 time: 0.221375 Sep 01 00:32:25.406192 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 183/371] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:25 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1469 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:25.607384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-e3248e67-f8cf-48df-b661-b3cf4c218c48 req-2e77bd5a-c897-4337-914e-2d472657b8fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67263881-ac3a-4855-965b-19c5b25c35c6", "name": "network-vif-deleted", "tag": "979409b1-abcb-42c6-b49f-ac409f9aef9e"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:25.619065 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e3248e67-f8cf-48df-b661-b3cf4c218c48 req-2e77bd5a-c897-4337-914e-2d472657b8fb service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:25.620096 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e3248e67-f8cf-48df-b661-b3cf4c218c48 req-2e77bd5a-c897-4337-914e-2d472657b8fb service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:25.620585 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e3248e67-f8cf-48df-b661-b3cf4c218c48 req-2e77bd5a-c897-4337-914e-2d472657b8fb service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:25.643180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-e3248e67-f8cf-48df-b661-b3cf4c218c48 req-2e77bd5a-c897-4337-914e-2d472657b8fb service nova] Creating event network-vif-deleted:979409b1-abcb-42c6-b49f-ac409f9aef9e for instance 67263881-ac3a-4855-965b-19c5b25c35c6 on hv-cinder-82002 Sep 01 00:32:25.648943 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-e3248e67-f8cf-48df-b661-b3cf4c218c48 req-2e77bd5a-c897-4337-914e-2d472657b8fb service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045391 Sep 01 00:32:25.649551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 189/372] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:25.942382 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:25.942987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:25.949502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:25.950058 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:25.950628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:25.951651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:25.952163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:25.952897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:26.158916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:26.168158 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:26.169690 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:26.170851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0867aadb-e0b4-49a0-98e2-86484f2df1a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.232621 Sep 01 00:32:26.171411 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 184/373] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:25 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:26.430487 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:26.431285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:26.441569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:26.442518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:26.443088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:26.443904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:26.444674 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:26.445271 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:26.493475 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:26.494579 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:26.494579 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:26.494851 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lazy-loading 'fault' on Instance uuid 67263881-ac3a-4855-965b-19c5b25c35c6 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:32:26.540042 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '04edb638af8c43a78db9ef629154df83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3747df9616604e22826b8f308eac57e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:26.547686 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0f498699-5e7c-4ea5-8dfb-f8b8edb2ea19 tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 200 len: 1304 microversion: 2.1 time: 0.124184 Sep 01 00:32:26.548258 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 190/374] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:26 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:27.198394 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:27.199584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:27.206471 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:27.206955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:27.207397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:27.208100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:27.208770 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:27.209338 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:27.214576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:27.363724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:27.373590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:27.375029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:27.376253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-586f8a05-429c-4cbf-8255-b8f6f870c96f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.181951 Sep 01 00:32:27.376867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 185/375] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:27 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:27.572305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:27.573205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] [instance: 67263881-ac3a-4855-965b-19c5b25c35c6] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:27.581231 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:27.581820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:27.582349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:27.583292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:27.584120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:27.584868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:27.599682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] HTTP exception thrown: Instance 67263881-ac3a-4855-965b-19c5b25c35c6 could not be found. Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Request method failure captured: Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 HTTP/1.1 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_2E72Pxa-Xj15jyWiN3X6leRYFBhE_7USctAfZ5JlZTL5taeflqXqPDsR7JOHhLC4ZJCfM1CZFilCpQQTholct93pY5nXZi4x7wwT6Nz2kdF3BMKkCYP7n7eXKgkVr2pW-8MqKTa9Ey72kJ-dBP5lEPTS6dvl_M8tzXBfxI76LB-A4 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 3747df9616604e22826b8f308eac57e3 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-VolumesNegativeTest-434449103 Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:32:27.601477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3747df9616604e22826b8f308eac57e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3747df9616604e22826b8f308eac57e3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3747df9616604e22826b8f308eac57e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3747df9616604e22826b8f308eac57e3"}]}] Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-VolumesNegativeTest-434449103 Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 3747df9616604e22826b8f308eac57e3 Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-VolumesNegativeTest-434449103 Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-VolumesNegativeTest-434449103-project Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 04edb638af8c43a78db9ef629154df83 Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-VolumesNegativeTest-434449103-project Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 67263881-ac3a-4855-965b-19c5b25c35c6 could not be found. Sep 01 00:32:27.603025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '67263881-ac3a-4855-965b-19c5b25c35c6'} Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67263881-ac3a-4855-965b-19c5b25c35c6 could not be found. Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:32:27.604677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67263881-ac3a-4855-965b-19c5b25c35c6 could not be found. Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67263881-ac3a-4855-965b-19c5b25c35c6 could not be found. Sep 01 00:32:27.605993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:32:27.607088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] Returning 404 to user: Instance 67263881-ac3a-4855-965b-19c5b25c35c6 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:32:27.607088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cd742899-e34d-4e7a-9cc2-ae71c96fd60d tempest-VolumesNegativeTest-434449103 tempest-VolumesNegativeTest-434449103-project] 10.222.0.25 "GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6" status: 404 len: 111 microversion: 2.1 time: 0.035429 Sep 01 00:32:27.607088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 191/376] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:27 2022] GET /compute/v2.1/servers/67263881-ac3a-4855-965b-19c5b25c35c6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:32:28.399270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:28.399911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:28.408817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:28.409935 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:28.410666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:28.411617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:28.412238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:28.412793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:28.560136 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:28.569646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:28.571475 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:28.574173 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-47f6409f-7caa-4364-a4ea-fcb4744ca227 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.178192 Sep 01 00:32:28.574933 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 186/377] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:28 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:29.598671 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:29.601249 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:29.608215 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:29.608824 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:29.609379 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:29.610205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:29.610720 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:29.611210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:30.059613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:30.074600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:30.076409 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:30.077907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6eed53ea-e648-445e-9041-f7701941fb6f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.483097 Sep 01 00:32:30.078693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 192/378] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:29 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:31.101508 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:31.102236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:31.109583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:31.110061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:31.110518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:31.111216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:31.111664 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:31.112082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:31.255150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:31.264661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:31.266102 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:31.267267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-94fcee01-ded6-4b6c-8b26-d4fad0e7dbab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.169612 Sep 01 00:32:31.267821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 187/379] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:31 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:32.292475 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:32.293853 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:32.305943 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:32.307904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:32.308905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:32.309817 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:32.310442 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:32.311389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:32.514208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:32.525372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:32.527115 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:32.528413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e069394c-9d52-44fe-bf49-317dd260af57 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.240845 Sep 01 00:32:32.541865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 193/380] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:32 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:32.928916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:32.929472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:32.936112 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:32.936628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:32.937269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:32.937968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:32.938418 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:32.938840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:32.965470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-35101575-d7fb-4e5e-aa50-25f8d2afaab8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/ips" status: 200 len: 150 microversion: 2.1 time: 0.040328 Sep 01 00:32:32.966137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 188/381] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:32:32 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:33.555328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:33.555932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:33.563531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:33.565050 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:33.565509 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:33.566247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:33.566742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:33.567198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:33.708870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:33.719675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:33.721453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:33.722879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2df23d49-2f53-419b-90c9-f96377965896 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.171375 Sep 01 00:32:33.723559 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 194/382] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:33 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:34.401152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35c34b6-212d-4b2b-9caa-67988aaf9a16"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:34.403816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:34.411157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:34.411635 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:34.412063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:34.412781 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:34.413227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:34.413644 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:34.747401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:34.747971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:34.754637 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:34.755234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:34.755672 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:34.756364 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:34.757001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:34.757430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:34.896827 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:34.906033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:34.907405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:34.908707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d0f67144-b853-464d-a6da-a2f55fa3676d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.165828 Sep 01 00:32:34.909640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 195/383] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:34 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:35.933395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:35.934132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:35.940697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:35.941184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:35.941620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:35.942389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:35.942781 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:35.943209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:36.093131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:36.102051 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:36.104299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:36.105737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d6eeb956-34b0-4aa2-9c39-9faa745d1b2c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.176898 Sep 01 00:32:36.106421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 196/384] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:35 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:37.131804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:37.132467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:37.141823 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:37.142597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:37.143295 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:37.144592 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:37.145099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:37.145536 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:37.318454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:37.329216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:37.332157 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:37.334200 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8fd6c9d0-42cb-4269-95e4-12c446c7b9aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.206308 Sep 01 00:32:37.348719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 197/385] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:37 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:38.364398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:38.365336 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:38.372100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:38.372627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:38.373070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:38.373820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:38.374275 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:38.374704 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:38.510563 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:38.519167 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:38.520631 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:38.521802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-335b0d7c-101b-485a-b71c-c16f9f170b0f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.161487 Sep 01 00:32:38.522420 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 198/386] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:38 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:32:39.383545 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4966fb20-73cc-472d-892e-842c65680d31 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.987039 Sep 01 00:32:39.385055 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 189/387] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:32:34 2022] POST /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments => generated 194 bytes in 4989 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:39.545713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:39.546491 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:39.553896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:39.554417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:39.554862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:39.555598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:39.556064 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:39.557305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:39.698420 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:39.708064 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:39.709518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:39.710693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b53ecf7e-5883-4784-9774-453764550466 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.169901 Sep 01 00:32:39.711276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 199/388] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:39 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:40.735569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:40.736457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:40.745160 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:40.745805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:40.746414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:40.747580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:40.748237 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:40.748991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:40.898438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:40.906998 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:40.908419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:40.909587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-48ec681b-f116-4da0-a8cd-ae1ae9b9251f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.179222 Sep 01 00:32:40.910155 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 190/389] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:40 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:41.932660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:41.933365 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:41.939786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:41.940266 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:41.940749 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:41.941440 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:41.941919 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:41.942342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:42.073059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:42.081788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:42.083203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:42.084349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a8b0958a-8619-4d80-9800-929883f0494b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.155779 Sep 01 00:32:42.084935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 200/390] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:41 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:43.109758 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:43.110366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:43.117112 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:43.117591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:43.118027 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:43.119337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:43.119787 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:43.120206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:43.249566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:43.258204 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:43.259786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:43.260980 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-11a8c0da-0584-4485-811e-b28b355aea90 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.155132 Sep 01 00:32:43.261535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 191/391] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:43 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:44.284599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:44.285210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:44.291760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:44.292243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:44.292727 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:44.293415 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:44.293868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:44.294296 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:44.423548 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:44.432570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:44.434013 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:44.435164 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1c74d124-a650-40bd-891d-50f45d03bb65 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.154500 Sep 01 00:32:44.435741 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 201/392] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:44 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:45.459475 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:45.460085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:45.467190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:45.467672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:45.468109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:45.468834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:45.469291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:45.469717 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:45.603595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:45.612143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:45.613615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:45.614772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6a406bed-43cf-4ab5-9af1-cf392c30b1e1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.159177 Sep 01 00:32:45.615328 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 192/393] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:45 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:46.638294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:46.638898 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:46.645392 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:46.645874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:46.646306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:46.646997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:46.647444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:46.647867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:46.781570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:46.790253 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:46.791931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:46.793124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-de001e21-0df4-452b-9390-d62aa1f98ae0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.158981 Sep 01 00:32:46.793799 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 202/394] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:46 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:46.919749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-21f54401-cb99-4a93-ad73-505eb781ccc0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: .version_select at 0x7fcadfe590d0>, body: {"keypair": {"name": "tempest-keypair-1584182130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxMnF+8NQHOk90xLG/ItTIfbQWRCZDDz5UkjoOZVQITayUd1BpYJBeTC5ji5HwoqeQSs29EEMba6QxLCE+3Q8P16EUpOH2aGObj8bibpIQ4IHnzitUeJKVQwURDd0C2gw=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:46.935781 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-21f54401-cb99-4a93-ad73-505eb781ccc0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:32:46.939589 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-21f54401-cb99-4a93-ad73-505eb781ccc0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:32:46.961568 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-21f54401-cb99-4a93-ad73-505eb781ccc0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045564 Sep 01 00:32:46.962786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 193/395] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:32:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:47.815381 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:47.816996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:47.824066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:47.824574 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:47.825010 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:47.825748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:47.826203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:47.826784 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:47.966299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:47.975445 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:47.976917 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:47.978357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a723920b-c86b-413d-b8f3-669941bc8459 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.166913 Sep 01 00:32:47.978908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 203/396] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:47 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:48.257185 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1244203182", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c58401f2-7e87-4905-8554-61c4ec2b1ce1"}], "security_groups": [{"name": "tempest-securitygroup--1270150134"}], "key_name": "tempest-keypair-1584182130", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:48.362411 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] validate_networks() for [('c58401f2-7e87-4905-8554-61c4ec2b1ce1', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:32:48.732744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:32:48.733169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:32:48.733638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:32:48.734069 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:32:48.734475 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:32:48.743201 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:48.743764 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:48.744200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:48.744957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:48.745407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:48.745828 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:48.762643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:32:48.766537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:32:48.777833 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:32:48.780120 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:32:48.826401 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a9c6c631-9da3-4193-a01a-b7879be219a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.573940 Sep 01 00:32:48.827044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 194/397] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:32:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 575 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:32:48.838755 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-47fd8061-09b2-4682-b0a5-873f001f4dd4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:48.839367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-47fd8061-09b2-4682-b0a5-873f001f4dd4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:48.894847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-47fd8061-09b2-4682-b0a5-873f001f4dd4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:48.902767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-47fd8061-09b2-4682-b0a5-873f001f4dd4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1242 microversion: 2.1 time: 0.068575 Sep 01 00:32:48.903329 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 204/398] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:48 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:49.001393 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:49.002139 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:49.008267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:49.009486 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:49.009995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:49.010761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:49.011289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:49.011890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:49.148741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:49.158185 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:49.159629 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:49.160809 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4deebf44-9d5c-431c-b811-c045eb6a519d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.163341 Sep 01 00:32:49.161373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 195/399] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:48 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:49.436252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-e5b3de1f-7566-4500-bcc7-967ab49deecc req-808e39e0-ae4b-48c6-8e25-95e774e28118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "name": "network-vif-plugged", "status": "completed", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:49.448609 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e5b3de1f-7566-4500-bcc7-967ab49deecc req-808e39e0-ae4b-48c6-8e25-95e774e28118 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:49.449098 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e5b3de1f-7566-4500-bcc7-967ab49deecc req-808e39e0-ae4b-48c6-8e25-95e774e28118 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:49.449532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e5b3de1f-7566-4500-bcc7-967ab49deecc req-808e39e0-ae4b-48c6-8e25-95e774e28118 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:49.472008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-e5b3de1f-7566-4500-bcc7-967ab49deecc req-808e39e0-ae4b-48c6-8e25-95e774e28118 service nova] Creating event network-vif-plugged:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:32:49.477946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-e5b3de1f-7566-4500-bcc7-967ab49deecc req-808e39e0-ae4b-48c6-8e25-95e774e28118 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044831 Sep 01 00:32:49.479266 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 205/400] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:49.923080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:49.923927 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:49.930373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:49.931454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:49.931891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:49.932815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:49.933230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:49.933652 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:50.001082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:50.011798 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cc2616dc-3c02-41c1-90df-bb9461440125 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1294 microversion: 2.1 time: 0.092302 Sep 01 00:32:50.012832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 196/401] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:49 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1294 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:50.185418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:50.186122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:50.192179 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:50.192706 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:50.193150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:50.193851 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:50.194306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:50.194733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:50.325917 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:50.335057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:50.337181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:50.338411 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3605937d-4cb8-4688-a256-1c268cf3ffbc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.157897 Sep 01 00:32:50.339193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 206/402] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:50 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:51.034100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:51.034705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:51.037131 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:51.042805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:51.043282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:51.043710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:51.044395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:51.044865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:51.045280 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:51.113948 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:51.122407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fddeeb48-936e-41c6-8035-0383e95666a1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1300 microversion: 2.1 time: 0.092115 Sep 01 00:32:51.122969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 197/403] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:51 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:51.361934 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:51.362603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:51.370174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:51.370774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:51.371216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:51.372229 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:51.372756 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:51.373186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:51.513380 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:51.522231 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:51.523740 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:51.524934 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a12220fa-9d3d-469d-95d9-dd9b919fa3e9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.166877 Sep 01 00:32:51.525485 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 207/404] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:51 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:52.142835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:52.143385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:52.150452 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:52.150930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:52.151361 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:52.152047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:52.152502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:52.152941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:52.280578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:52.288266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6815aed0-b503-44ce-85b7-4c4a6dca1509 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1368 microversion: 2.1 time: 0.149333 Sep 01 00:32:52.288947 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 198/405] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:52 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:52.548663 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:52.549354 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:52.551847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:52.558262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:52.558763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:52.559233 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:52.559941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:52.560390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:52.560848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:52.566113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=100 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:52.701273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:52.711049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:52.712703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:52.714269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-97d073f4-f31e-44b6-979a-baa4bcf7dba4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1809 microversion: 2.20 time: 0.169726 Sep 01 00:32:52.714922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 208/406] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:52 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:53.024762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-fdbc0143-5e8c-4a41-947c-b2eff1aa1fb3 req-da6f4f5a-f68b-404c-be50-bca9e3bf45be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed76d3a-7638-4a6e-b229-054bd6f51d89", "tag": "9c25cd75-9b62-4d21-a2e4-5125ad46047f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:53.035782 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-fdbc0143-5e8c-4a41-947c-b2eff1aa1fb3 req-da6f4f5a-f68b-404c-be50-bca9e3bf45be service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:53.036402 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-fdbc0143-5e8c-4a41-947c-b2eff1aa1fb3 req-da6f4f5a-f68b-404c-be50-bca9e3bf45be service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:53.037012 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-fdbc0143-5e8c-4a41-947c-b2eff1aa1fb3 req-da6f4f5a-f68b-404c-be50-bca9e3bf45be service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:53.058823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-fdbc0143-5e8c-4a41-947c-b2eff1aa1fb3 req-da6f4f5a-f68b-404c-be50-bca9e3bf45be service nova] Creating event network-changed:9c25cd75-9b62-4d21-a2e4-5125ad46047f for instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 on hv-cinder-82002 Sep 01 00:32:53.064213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-fdbc0143-5e8c-4a41-947c-b2eff1aa1fb3 req-da6f4f5a-f68b-404c-be50-bca9e3bf45be service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045282 Sep 01 00:32:53.064977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 199/407] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:32:53.309482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:53.310262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:53.316903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:53.317486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:53.318091 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:53.318900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:53.319401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:53.319954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:53.450081 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:53.458001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6bcae698-8952-4868-8af3-01d7389b0766 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1368 microversion: 2.1 time: 0.153140 Sep 01 00:32:53.458689 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 209/408] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:53 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:53.738228 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:53.738912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:53.745110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:53.745580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:53.746010 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:53.746683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:53.747126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:53.747540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:53.885126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:53.893744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:53.895152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:53.896295 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0a8d15ac-5f44-48b6-9841-7250c0e64654 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1796 microversion: 2.20 time: 0.162847 Sep 01 00:32:53.896885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 200/409] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:32:53 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1796 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:32:54.479787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:54.480425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:54.486972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:54.487391 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:54.487827 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:54.488542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:54.488992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:54.489412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:54.621530 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:54.628975 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fe04a2fd-ebc1-4fe7-bc9e-f7e13cc75615 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1368 microversion: 2.1 time: 0.153635 Sep 01 00:32:54.629533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 210/410] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:54 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:55.649908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:55.650763 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:55.657868 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:55.658496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:55.658998 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:55.659850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:55.660419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:55.660952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:55.803697 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:55.812212 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ee2fc8bf-f24f-4375-a511-448646ae74cf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1368 microversion: 2.1 time: 0.166598 Sep 01 00:32:55.812886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 201/411] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:55 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:56.833584 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:56.834148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:56.841915 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:56.842401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:56.842836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:56.843630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:56.844108 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:56.844582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:56.974037 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:56.982113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-770196c9-d118-47c4-9d7f-5aa30a6eefff tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1368 microversion: 2.1 time: 0.152713 Sep 01 00:32:56.982673 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 211/412] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:56 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:57.494209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-c34b5c67-ea08-425e-8217-eb29ff92422f req-ee0297fb-434f-45a5-afd1-b98300574058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed76d3a-7638-4a6e-b229-054bd6f51d89", "name": "network-vif-plugged", "status": "completed", "tag": "9c25cd75-9b62-4d21-a2e4-5125ad46047f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:32:57.505179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c34b5c67-ea08-425e-8217-eb29ff92422f req-ee0297fb-434f-45a5-afd1-b98300574058 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:57.505743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c34b5c67-ea08-425e-8217-eb29ff92422f req-ee0297fb-434f-45a5-afd1-b98300574058 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:57.506222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c34b5c67-ea08-425e-8217-eb29ff92422f req-ee0297fb-434f-45a5-afd1-b98300574058 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:57.510415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:57.519105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-c34b5c67-ea08-425e-8217-eb29ff92422f req-ee0297fb-434f-45a5-afd1-b98300574058 service nova] Creating event network-vif-plugged:9c25cd75-9b62-4d21-a2e4-5125ad46047f for instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 on hv-cinder-82002 Sep 01 00:32:57.524105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-c34b5c67-ea08-425e-8217-eb29ff92422f req-ee0297fb-434f-45a5-afd1-b98300574058 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034066 Sep 01 00:32:57.525226 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 202/413] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:32:58.003534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:58.004176 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:58.011403 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:58.011886 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:58.012355 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:58.013083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:58.013541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:58.013972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:58.143603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:58.152001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1bf73b69-d77c-4f4d-8a8c-feea8ab94d23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1368 microversion: 2.1 time: 0.152320 Sep 01 00:32:58.152587 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 212/414] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:57 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:59.172829 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:59.173535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:59.176114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:59.176772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=10 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:59.183459 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:59.183935 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:59.184363 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:59.185080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:59.185530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:59.185947 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:59.314338 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:32:59.322563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bf2f421e-f61c-4a91-8ab5-e44cdfdea913 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1557 microversion: 2.1 time: 0.153914 Sep 01 00:32:59.323160 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 203/415] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:32:59 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:32:59.345965 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:32:59.346553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:32:59.348393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:32:59.354537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:59.355020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:59.355455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:59.356146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:32:59.356622 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:32:59.357048 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:32:59.432903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-81ae7b3f-a5dc-4880-9b9f-57570b4e9f14 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090812 Sep 01 00:32:59.433502 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 213/416] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:32:59 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:00.522520 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-1ee62afb-2ea7-4ae9-9f09-297505cdedff req-b5c34fb1-76b2-4bbd-8d0d-f7d971b421dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ed76d3a-7638-4a6e-b229-054bd6f51d89", "tag": "9c25cd75-9b62-4d21-a2e4-5125ad46047f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:00.532890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1ee62afb-2ea7-4ae9-9f09-297505cdedff req-b5c34fb1-76b2-4bbd-8d0d-f7d971b421dc service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:00.533372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1ee62afb-2ea7-4ae9-9f09-297505cdedff req-b5c34fb1-76b2-4bbd-8d0d-f7d971b421dc service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:00.533800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1ee62afb-2ea7-4ae9-9f09-297505cdedff req-b5c34fb1-76b2-4bbd-8d0d-f7d971b421dc service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:00.546029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-1ee62afb-2ea7-4ae9-9f09-297505cdedff req-b5c34fb1-76b2-4bbd-8d0d-f7d971b421dc service nova] Creating event network-changed:9c25cd75-9b62-4d21-a2e4-5125ad46047f for instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 on hv-cinder-82002 Sep 01 00:33:00.550924 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-1ee62afb-2ea7-4ae9-9f09-297505cdedff req-b5c34fb1-76b2-4bbd-8d0d-f7d971b421dc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032074 Sep 01 00:33:00.551518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 204/417] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:05.917776 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:05.918476 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:05.925770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:05.926305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:05.926733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:05.927456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:05.928163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:05.928427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:06.053212 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lazy-loading 'services' on Instance uuid 5f8ee3b6-8801-4650-8819-1587d9da7d98 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:33:06.164095 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c6360433-923e-477c-8cee-489dd22d3c68 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-volume_attachments/e4e951db-b64a-4cfd-96ec-110ad2bc5efd" status: 202 len: 0 microversion: 2.1 time: 0.252509 Sep 01 00:33:06.164907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 214/418] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:33:05 2022] DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-volume_attachments/e4e951db-b64a-4cfd-96ec-110ad2bc5efd => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:07.281788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ee8f69cd-7df2-4920-94cf-0601d9897711 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:07.287859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee8f69cd-7df2-4920-94cf-0601d9897711 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:07.288341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee8f69cd-7df2-4920-94cf-0601d9897711 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:07.288837 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ee8f69cd-7df2-4920-94cf-0601d9897711 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:07.310462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ee8f69cd-7df2-4920-94cf-0601d9897711 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Going to try to stop instance {{(pid=132498) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 01 00:33:07.351022 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ee8f69cd-7df2-4920-94cf-0601d9897711 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action" status: 202 len: 0 microversion: 2.1 time: 0.073810 Sep 01 00:33:07.352061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 205/419] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:33:07 2022] POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:07.362071 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:07.362780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:07.371087 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:07.371599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:07.372041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:07.372793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:07.373253 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:07.373685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:07.512662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:07.520316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-13c1cd8f-5045-4ddb-a2e7-3538ce7f3217 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.162917 Sep 01 00:33:07.521120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 215/420] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:07 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:08.542174 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:08.542861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:08.548985 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:08.549406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:08.549836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:08.550512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:08.550955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:08.551370 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:08.682650 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:08.690295 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f23a518a-42fc-4ec6-84e5-83d63ca548ad tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.152804 Sep 01 00:33:08.690864 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 206/421] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:08 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:09.713340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:09.713926 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:09.719831 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:09.720302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:09.720763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:09.721447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:09.721889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:09.722304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:09.849239 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:09.858784 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4a2b9bc2-1027-44fd-9a92-fc9758c6924f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.150070 Sep 01 00:33:09.859358 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 216/422] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:09 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:10.881865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:10.882490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:10.888994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:10.889472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:10.889903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:10.890584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:10.891027 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:10.891445 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:11.018076 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:11.025884 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-395bbadd-dae6-4a58-8f4a-81a4af6de91f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.147936 Sep 01 00:33:11.026452 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 207/423] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:10 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:12.047265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:12.047875 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:12.054840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:12.055315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:12.055788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:12.056481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:12.056949 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:12.057367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:12.183214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:12.190954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1a7b409f-293e-4d2e-9e38-4c88bc357d5b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.147524 Sep 01 00:33:12.191516 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 217/424] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:12 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:12.209997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f68e1fd8-d399-48e1-9d9e-45048db32359"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:12.212605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:12.218827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:12.219316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:12.219757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:12.220453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:12.220968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:12.221394 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:12.464075 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d0065d42-8520-4a7f-a1ab-31eef91f1a9a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257752 Sep 01 00:33:12.464753 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 208/425] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:33:12 2022] POST /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:13.213239 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:13.213850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:13.220258 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:13.220734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:13.221177 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:13.221896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:13.222347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:13.222771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:13.352193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:13.359859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-29ea0c25-1e8c-4fa0-a0ba-5232ee237a7e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.151233 Sep 01 00:33:13.360428 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 218/426] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:13 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:14.381819 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:14.383338 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:14.390127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:14.390603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:14.391031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:14.391716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:14.392159 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:14.392679 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:14.523712 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:14.531282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b0c37d42-f476-41ef-930e-fd526e73c7af tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.153704 Sep 01 00:33:14.531841 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 209/427] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:14 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:15.552695 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:15.553766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:15.560867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:15.561360 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:15.561795 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:15.562494 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:15.562945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:15.563368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:15.698963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:15.706906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7f600568-afd5-4151-99b0-0eed45989360 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.158150 Sep 01 00:33:15.707459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 219/428] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:15 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:16.727726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:16.728409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:16.734853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:16.735327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:16.735758 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:16.736436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:16.736909 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:16.737326 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:16.870067 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:16.877651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-93017133-e27b-496b-848d-57c0657da5b2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1679 microversion: 2.1 time: 0.154344 Sep 01 00:33:16.878209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 210/429] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:16 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:17.897560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:17.898339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:17.904788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:17.905277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:17.905713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:17.906397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:17.906849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:17.907269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:18.253503 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:18.261462 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4e2c44bf-fc77-404b-978b-c22d7f665b8d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1656 microversion: 2.1 time: 0.367741 Sep 01 00:33:18.262025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 220/430] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:17 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1656 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:18.281318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-86f3efa6-af7c-41cf-af52-f35b61a3c762 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:18.287621 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86f3efa6-af7c-41cf-af52-f35b61a3c762 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:18.288092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86f3efa6-af7c-41cf-af52-f35b61a3c762 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:18.289157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86f3efa6-af7c-41cf-af52-f35b61a3c762 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:18.310785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-86f3efa6-af7c-41cf-af52-f35b61a3c762 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Going to try to start instance {{(pid=132498) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 01 00:33:18.350441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-86f3efa6-af7c-41cf-af52-f35b61a3c762 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action" status: 202 len: 0 microversion: 2.1 time: 0.072745 Sep 01 00:33:18.351527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 211/431] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:33:18 2022] POST /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:18.359570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:18.360203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:18.366076 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:18.367312 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:18.367754 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:18.368605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:18.369056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:18.369479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:18.496480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:18.503978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a2435a58-b4b8-4f0d-b62a-ac97ce99d0c5 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1665 microversion: 2.1 time: 0.148198 Sep 01 00:33:18.504545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 221/432] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:18 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1665 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:19.525724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:19.526411 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:19.532678 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:19.533184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:19.533616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:19.534361 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:19.534805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:19.535223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:19.662508 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:19.670196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2f13217c-94bf-443b-badd-2cea829d45b6 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1665 microversion: 2.1 time: 0.149143 Sep 01 00:33:19.670762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 212/433] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:19 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:19.985056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:19.987323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:19.993829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:19.994302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:19.994728 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:19.995475 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:19.995920 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:19.996367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:20.021757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'flavor' on Instance uuid abf8d128-7684-4263-babf-222cc0beae80 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:33:20.126090 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:20.147362 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-af131c4f-48cf-4cb4-b47c-b64d112f11ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/action" status: 200 len: 32 microversion: 2.1 time: 0.166270 Sep 01 00:33:20.147981 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 222/434] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:33:19 2022] POST /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:33:20.157334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:20.157941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:20.163910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:20.164390 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:20.164854 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:20.165542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:20.165992 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:20.166417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:20.299080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:20.307730 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-73071aeb-136d-4c8f-bd22-60090dadca02 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.154183 Sep 01 00:33:20.308292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 213/435] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:20 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:20.692085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:20.692816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:20.699635 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:20.700117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:20.700573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:20.701265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:20.701713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:20.702128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:20.837547 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:20.845247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-156a133a-20fd-4037-a9db-c98b2d0d357a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1669 microversion: 2.1 time: 0.157826 Sep 01 00:33:20.845810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 223/436] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:20 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:21.329843 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:21.330405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:21.332889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=34 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:21.338318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:21.338801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:21.339263 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:21.339951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:21.340401 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:21.340846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:21.469509 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:21.478267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5335ada6-235f-41c7-a1a7-d1e74ae24b00 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.152591 Sep 01 00:33:21.478837 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 214/437] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:21 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:22.499089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:22.499620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:22.506078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:22.506559 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:22.507702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:22.508603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:22.509060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:22.509489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:22.635583 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:22.643725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3532cd79-e18f-4bea-9d8f-dc0b8faf3fbb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.148605 Sep 01 00:33:22.644281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 224/438] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:22 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:23.664652 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:23.665255 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:23.671827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:23.672304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:23.672762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:23.673446 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:23.673887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:23.674300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:23.807198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:23.815327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c0fcd9a9-b333-4772-9d36-21afddc5b08a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.154717 Sep 01 00:33:23.815883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 215/439] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:23 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:24.837537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:24.838057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:24.840929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=34 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:24.846577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:24.847058 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:24.847493 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:24.848176 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:24.848652 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:24.849099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:24.981078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:24.989179 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-03cb6d1f-231d-4258-b8e0-01207642b1ad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.156039 Sep 01 00:33:24.989735 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 225/440] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:24 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:26.009893 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:26.010504 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:26.016926 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:26.017409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:26.017846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:26.018533 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:26.018985 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:26.019408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:26.145176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:26.147848 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:26.154888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-124866cf-e716-490d-8741-5b30e032a138 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.149092 Sep 01 00:33:26.155462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 216/441] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:26 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:27.179582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:27.180575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:27.188396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:27.188906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:27.189345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:27.190028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:27.190479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:27.190901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:27.321862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:27.330276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9c08bdb6-8121-40a7-9fd7-f41556095e0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.157610 Sep 01 00:33:27.330846 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 226/442] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:27 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:28.351255 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:28.351941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:28.359448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:28.359928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:28.360362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:28.361216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:28.361667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:28.362087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:28.492590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:28.500673 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-aad4a529-b70f-4e1e-af0a-fe76324031d5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.153441 Sep 01 00:33:28.501233 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 217/443] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:28 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:29.521903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:29.522555 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:29.529412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:29.529745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:29.530182 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:29.530880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:29.531333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:29.531756 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:29.662610 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:29.670834 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-04dd1dd4-6379-4583-9301-fc3dc20a9ae5 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.153388 Sep 01 00:33:29.671397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 227/444] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:29 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:30.691602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:30.692202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:30.698844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:30.699317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:30.699745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:30.700422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:30.700890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:30.701310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:30.829059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:30.837730 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c163a9f5-3d60-45d3-bf3a-66fb318d52df tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.149967 Sep 01 00:33:30.838256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 218/445] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:30 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:31.859532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:31.860188 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:31.867366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:31.867851 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:31.868277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:31.868998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:31.869445 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:31.869867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:31.999787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:32.008193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cfb485ae-a69c-47af-aa62-5f244c5e609c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.153013 Sep 01 00:33:32.008788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 228/446] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:31 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:33.029033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:33.029577 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:33.035978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.036452 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.036910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.037642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.038167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.038584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.166714 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:33.174757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d0d12561-490b-4e4b-9f35-e3b1fd247f7e tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.149648 Sep 01 00:33:33.175322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 219/447] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:33 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:33.470836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:33.471370 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:33.478111 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.478610 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.479041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.479725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.480187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.480663 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.508859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-aeb9953c-1856-418f-9206-f4508d089dcb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments/3d946fb7-0f24-4b07-915f-3089ebc5086c" status: 200 len: 194 microversion: 2.20 time: 0.042041 Sep 01 00:33:33.509421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 229/448] 10.222.0.25 () {60 vars in 1454 bytes} [Thu Sep 1 00:33:33 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments/3d946fb7-0f24-4b07-915f-3089ebc5086c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:33:33.575341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:33.575830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:33.581880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.582358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.582789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.583474 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.583917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.584912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.706760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lazy-loading 'services' on Instance uuid 17b64cab-6c29-4261-b029-bf0bb5d3ee9a {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:33:33.817246 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9dbbd65b-f117-49a7-ac6b-7ee5301b9c3c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments/3d946fb7-0f24-4b07-915f-3089ebc5086c" status: 202 len: 0 microversion: 2.20 time: 0.245612 Sep 01 00:33:33.817826 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 220/449] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Sep 1 00:33:33 2022] DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments/3d946fb7-0f24-4b07-915f-3089ebc5086c => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:33:33.826254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:33.828803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:33.836047 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.836777 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.837218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.837920 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:33.838433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:33.838809 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:33.869598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a81373db-248b-4f2b-9b64-f84b50640de4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047229 Sep 01 00:33:33.870268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 230/450] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 00:33:33 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:33:34.197965 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:34.198647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:34.205242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:34.205714 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:34.206142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:34.206818 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:34.207258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:34.207677 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:34.339535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:34.349421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-eb277991-433c-4e4e-8ec0-47f099104473 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.156656 Sep 01 00:33:34.350383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 221/451] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:34 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:34.882079 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:34.884206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:34.890582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:34.891097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:34.891533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:34.892225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:34.892723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:34.893150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:34.922153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-af633899-c649-4e9b-9868-9c72aee587ac tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044030 Sep 01 00:33:34.922691 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 231/452] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 00:33:34 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:34.983330 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:34.984043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:34.989855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:34.990331 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:34.991352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:34.992030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:34.992475 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:34.992917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:35.016807 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:33:35.088151 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c1056846-98fd-4453-ac71-f6a30876f2fb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 204 len: 0 microversion: 2.20 time: 0.108312 Sep 01 00:33:35.088778 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 222/453] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 00:33:34 2022] DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 00:33:35.097309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:35.098038 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:35.106671 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:35.107188 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:35.107646 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:35.108580 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:35.109039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:35.109462 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:35.236259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:35.244424 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:35.245879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:35.247101 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-752e107a-5fab-434c-80ae-15f91767a76b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.154016 Sep 01 00:33:35.247677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 232/454] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:35 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:35.369962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:35.370652 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:35.377020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:35.377502 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:35.377932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:35.378614 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:35.379056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:35.379474 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:35.510675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:35.518999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f536d072-807d-4f9e-869a-c6f5c710ffef tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.153518 Sep 01 00:33:35.519561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 223/455] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:35 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:36.269725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:36.270338 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:36.276864 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:36.277353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:36.277788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:36.278486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:36.278940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:36.279367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:36.410242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:36.418729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:36.420168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:36.421437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d398c6a9-5253-4ca9-9b06-abff3c1aa261 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1724 microversion: 2.20 time: 0.155660 Sep 01 00:33:36.421995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 233/456] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:36 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:36.541006 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:36.541616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:36.547998 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:36.548470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:36.548934 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:36.549612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:36.550057 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:36.550473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:36.686973 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:36.695460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-94d9dde6-efbd-4cd8-8bd8-3feb3df7fb55 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.158813 Sep 01 00:33:36.696029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 224/457] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:36 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:37.446995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:37.447661 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:37.455427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:37.455950 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:37.456392 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:37.457122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:37.457575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:37.458060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:37.520966 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:37.529429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:37.530916 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:37.532074 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-89f3af78-6a35-484a-b08e-6aa45659237e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1656 microversion: 2.20 time: 0.090528 Sep 01 00:33:37.532657 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 234/458] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:37 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1656 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:37.711395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-98dd9c4a-721c-4240-9045-e0500a5abb36 req-94b8516c-ef15-4e54-bfde-e54d562cb77f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b64cab-6c29-4261-b029-bf0bb5d3ee9a", "name": "network-vif-deleted", "tag": "eeee7cd1-6746-4dc1-883d-5b9873db8131"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:37.717705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:37.718556 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:37.721617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-98dd9c4a-721c-4240-9045-e0500a5abb36 req-94b8516c-ef15-4e54-bfde-e54d562cb77f service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:37.722354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-98dd9c4a-721c-4240-9045-e0500a5abb36 req-94b8516c-ef15-4e54-bfde-e54d562cb77f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:37.722995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-98dd9c4a-721c-4240-9045-e0500a5abb36 req-94b8516c-ef15-4e54-bfde-e54d562cb77f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:37.725616 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:37.726268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:37.726702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:37.727409 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:37.727847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:37.728457 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:37.737417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-98dd9c4a-721c-4240-9045-e0500a5abb36 req-94b8516c-ef15-4e54-bfde-e54d562cb77f service nova] Creating event network-vif-deleted:eeee7cd1-6746-4dc1-883d-5b9873db8131 for instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a on hv-cinder-82002 Sep 01 00:33:37.745194 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-98dd9c4a-721c-4240-9045-e0500a5abb36 req-94b8516c-ef15-4e54-bfde-e54d562cb77f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037755 Sep 01 00:33:37.746279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 225/459] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:37.871505 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:37.879951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-295744a3-722c-49ea-aa91-f5734a07614a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.165984 Sep 01 00:33:37.881491 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 235/460] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:37 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:38.556143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:38.556866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:38.564329 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:38.564906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:38.565423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:38.566194 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:38.566703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:38.567188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:38.608353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:38.608877 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:38.609445 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:38.609904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lazy-loading 'fault' on Instance uuid 17b64cab-6c29-4261-b029-bf0bb5d3ee9a {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:33:38.665739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:38.674550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:38.676192 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:38.677442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-85031744-5669-49f4-a8a1-8879c21b9b82 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 200 len: 1371 microversion: 2.20 time: 0.126060 Sep 01 00:33:38.678809 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 226/461] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:38 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 1371 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:38.901722 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:38.902334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:38.908933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:38.909419 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:38.909858 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:38.910558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:38.911019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:38.911446 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:39.056631 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:39.065542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-501bb27d-72ba-460c-920a-01d672525050 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.167805 Sep 01 00:33:39.066230 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 236/462] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:38 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:39.700825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:39.701431 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:39.708263 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:39.708772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:39.709741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:39.710435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:39.710872 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:39.711289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:39.726585 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] HTTP exception thrown: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Request method failure captured: Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a HTTP/1.1 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0Jto_idGse7KpaAJGiE0NW6NXnax9XMQgF0dH0WgElnn35jvhkJ4SuXzChwbaN9OaobEaS9qgjmPIQtpBdgTHg-hy5CjBRRUptSIIvjmvkfHORGVDAe_fCxUzqIhf8C8hJdrHrc-dwza_jwGcl7QAh9iWw7Wb6PE8huUc7l_bXyww Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:33:39.728216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06942912e37346eaa2310a56b84f3886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06942912e37346eaa2310a56b84f3886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}] Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: ecf29db866eb43fa954b0d440577f45f Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:33:39.729836 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '17b64cab-6c29-4261-b029-bf0bb5d3ee9a'} Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:33:39.730728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:33:39.732150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:39.733453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Returning 404 to user: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:33:39.733453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5ddab40d-0993-4460-874f-bf5eaadc9489 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 404 len: 111 microversion: 2.20 time: 0.032736 Sep 01 00:33:39.733453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 227/463] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:39 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:33:39.743184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8ba46dd0-2065-4fae-a647-c8f28890b670 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '.version_select at 0x7fcadff16670>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:39.764799 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8ba46dd0-2065-4fae-a647-c8f28890b670 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881809288" status: 204 len: 0 microversion: 2.20 time: 0.026238 Sep 01 00:33:39.765387 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 237/464] 10.222.0.25 () {60 vars in 1262 bytes} [Thu Sep 1 00:33:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1881809288 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 00:33:40.087199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:40.087807 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:40.093815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:40.094296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:40.094726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:40.095408 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:40.095858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:40.096278 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:40.298365 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:40.307874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0553dbb3-73a1-47c1-bf7e-e3979ed59464 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1733 microversion: 2.1 time: 0.224511 Sep 01 00:33:40.308456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 228/465] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:40 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:40.472658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fefef126-7797-4aa2-b424-eefc008dc631 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'create', calling method: .version_select at 0x7fcadfe6be50>, body: {"keypair": {"name": "tempest-keypair-376637948", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI18pQuGc8YNl8Rpenekf7hAl2sedAqzTRQNN8FgqtH0/oq2MFeGxUhT7FLLqy7MSfzAm/3wfIibiyWU5NtQr9QDdEdH9kgVWgjJ7sgVhE9mMFv4OtH91XkBQ101oLHJxw=="}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:40.488811 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-fefef126-7797-4aa2-b424-eefc008dc631 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for project 06942912e37346eaa2310a56b84f3886. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:33:40.493334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-fefef126-7797-4aa2-b424-eefc008dc631 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for user ecf29db866eb43fa954b0d440577f45f and project 06942912e37346eaa2310a56b84f3886. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:33:40.514480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fefef126-7797-4aa2-b424-eefc008dc631 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.046419 Sep 01 00:33:40.515066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 238/466] 10.222.0.25 () {62 vars in 1200 bytes} [Thu Sep 1 00:33:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 48 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 01 00:33:41.330523 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:41.331296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:41.338230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:41.338946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:41.339376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:41.340079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:41.340536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:41.340962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:41.764259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:41.773239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6538b49a-eecb-4685-b472-0b738eb9451c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1713 microversion: 2.1 time: 0.446821 Sep 01 00:33:41.773811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 229/467] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:41 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1713 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:41.887459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:41.888035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:41.893968 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:41.894521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:41.895020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:41.895793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:41.897194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:41.897314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:41.980470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] HTTP exception thrown: Cannot 'detach_volume' instance abf8d128-7684-4263-babf-222cc0beae80 while it is in vm_state rescued Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Request method failure captured: Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments/f68e1fd8-d399-48e1-9d9e-45048db32359 HTTP/1.1 Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0GhEyvJ_PVtDwlrtoFX0jra6o3AW0UK3jQtMkVWq0CQXyAidUcnuMIcctNMm9_7xLitd3wLW3t31O_nGWArVIZv0ClA0s2dpWM-MpuwTu0duQUFEWKQXRR0_gXq-7E3X9iUoPQdHus1afQFGu2xNIheKMlEcOaFv5lHPugiRYNqkA Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:33:41.982647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}] Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: a6f08eaef2d149a9b0236d4bcbe03a92 Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:33:41.984273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Cannot 'detach_volume' instance abf8d128-7684-4263-babf-222cc0beae80 while it is in vm_state rescued Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'server_id': 'abf8d128-7684-4263-babf-222cc0beae80', 'id': 'f68e1fd8-d399-48e1-9d9e-45048db32359'} Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance abf8d128-7684-4263-babf-222cc0beae80 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:33:41.985110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance abf8d128-7684-4263-babf-222cc0beae80 while it is in vm_state rescued Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance abf8d128-7684-4263-babf-222cc0beae80 while it is in vm_state rescued Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:41.986751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Returning 409 to user: Cannot 'detach_volume' instance abf8d128-7684-4263-babf-222cc0beae80 while it is in vm_state rescued {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:33:41.988117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-79a3a297-2673-497e-b5b9-f7b5a2739a63 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments/f68e1fd8-d399-48e1-9d9e-45048db32359" status: 409 len: 152 microversion: 2.1 time: 0.101117 Sep 01 00:33:41.988117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 239/468] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:33:41 2022] DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments/f68e1fd8-d399-48e1-9d9e-45048db32359 => generated 152 bytes in 106 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 01 00:33:41.993625 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:41.994496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:42.001530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:42.002226 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:42.002733 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:42.003519 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:42.004129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:42.004664 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:42.071909 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-48a60281-81f2-41c3-8462-ef5a5e69b97a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "POST /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/action" status: 202 len: 0 microversion: 2.1 time: 0.082204 Sep 01 00:33:42.075928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 230/469] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:33:41 2022] POST /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:42.081925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:42.082534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:42.090170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:42.090938 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:42.091454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:42.092407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:42.092896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:42.093569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:42.110110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-350179209", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ec1bdb8-fcb4-45f0-8321-9a6d9446092b"}], "security_groups": [{"name": "tempest-securitygroup--2145776983"}], "key_name": "tempest-keypair-376637948", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:42.235031 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:42.243333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7c26285c-397b-497f-a127-cebf193a8ad3 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1721 microversion: 2.1 time: 0.165650 Sep 01 00:33:42.243899 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 240/470] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:42 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:42.277988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] validate_networks() for [('6ec1bdb8-fcb4-45f0-8321-9a6d9446092b', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:33:42.901965 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:33:42.902556 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:33:42.903185 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:33:42.903654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:33:42.904128 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:33:42.912969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:42.913441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:42.913874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:42.914587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:42.915030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:42.915451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:42.922433 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:42.936103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for project 06942912e37346eaa2310a56b84f3886. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:33:42.940248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Getting quotas for user ecf29db866eb43fa954b0d440577f45f and project 06942912e37346eaa2310a56b84f3886. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:33:42.952062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:33:42.954883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:33:43.002436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d9343f6b-c0bc-4505-a103-b0ef95126aa2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.897404 Sep 01 00:33:43.003012 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 231/471] 10.222.0.25 () {62 vars in 1188 bytes} [Thu Sep 1 00:33:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 01 00:33:43.013896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1703734e-71f4-4fa3-bf7d-909563874646 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:43.014611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1703734e-71f4-4fa3-bf7d-909563874646 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:43.067971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1703734e-71f4-4fa3-bf7d-909563874646 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:43.075335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1703734e-71f4-4fa3-bf7d-909563874646 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:43.076780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1703734e-71f4-4fa3-bf7d-909563874646 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:43.077868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1703734e-71f4-4fa3-bf7d-909563874646 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1280 microversion: 2.20 time: 0.067992 Sep 01 00:33:43.078676 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 241/472] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:43 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1280 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:33:43.265984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:43.266901 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:43.274149 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:43.274658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:43.275092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:43.275766 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:43.276212 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:43.276668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:43.409586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:43.418400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-335a2ee6-339c-4d47-8613-8bdc8b91ac7c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1721 microversion: 2.1 time: 0.156567 Sep 01 00:33:43.418960 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 232/473] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:43 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:44.100305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:44.100931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:44.108020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.108518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.108955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.109641 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.110133 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.110592 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.113300 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:44.175392 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:44.184035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:44.185494 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:44.186582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4ab4ece6-12b5-42ed-ae50-92c0abf81094 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1284 microversion: 2.20 time: 0.090230 Sep 01 00:33:44.187129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 242/474] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:44 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:44.208862 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:44.209439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:44.215494 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.215970 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.216403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.217177 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.217619 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.218034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.241239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3c93d025-6efa-4065-848c-c1257a6fb9f5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/ips" status: 200 len: 149 microversion: 2.1 time: 0.036144 Sep 01 00:33:44.241824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 233/475] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:33:44 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:44.253029 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f35c34b6-212d-4b2b-9caa-67988aaf9a16"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:44.255587 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:44.262432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.262916 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.263350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.264049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.264511 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.264944 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.342116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Invalid volume: volume f35c34b6-212d-4b2b-9caa-67988aaf9a16 is already attached to instances: d50b662a-3c38-40f3-92b5-37f693b80d25 Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: POST /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/os-volume_attachments HTTP/1.1 Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 74 Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:33:44.343964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {"volumeAttachment": {"volumeId": "f35c34b6-212d-4b2b-9caa-67988aaf9a16"}} Sep 01 00:33:44.345518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Invalid volume: volume f35c34b6-212d-4b2b-9caa-67988aaf9a16 is already attached to instances: d50b662a-3c38-40f3-92b5-37f693b80d25 Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'server_id': '1ed76d3a-7638-4a6e-b229-054bd6f51d89', 'body': {'volumeAttachment': {'volumeId': 'f35c34b6-212d-4b2b-9caa-67988aaf9a16'}}} Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f35c34b6-212d-4b2b-9caa-67988aaf9a16 is already attached to instances: d50b662a-3c38-40f3-92b5-37f693b80d25 Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:44.346437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f35c34b6-212d-4b2b-9caa-67988aaf9a16 is already attached to instances: d50b662a-3c38-40f3-92b5-37f693b80d25 Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:44.347773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f35c34b6-212d-4b2b-9caa-67988aaf9a16 is already attached to instances: d50b662a-3c38-40f3-92b5-37f693b80d25 Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 400 to user: Invalid volume: volume f35c34b6-212d-4b2b-9caa-67988aaf9a16 is already attached to instances: d50b662a-3c38-40f3-92b5-37f693b80d25 {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6f9314fa-2caa-4f4b-b56e-f0954320df7c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096407 Sep 01 00:33:44.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 243/476] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:33:44 2022] POST /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:33:44.355233 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:44.355703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:44.362225 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.362701 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.363132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.363819 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.364266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.364732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.391832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:33:44.439168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:44.440025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:44.449977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.450682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.451307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.452561 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.452942 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.453730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.469432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-013ac58b-035c-4d35-99fc-553cc96cab26 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 204 len: 0 microversion: 2.1 time: 0.117734 Sep 01 00:33:44.473984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 234/477] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:33:44 2022] DELETE /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 01 00:33:44.479464 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:44.480008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:44.486392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.486943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.487373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.488066 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:44.488531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:44.488950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:44.605598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:44.614803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e4ee9778-67c6-4cb9-9518-2699e253795c tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1721 microversion: 2.1 time: 0.179406 Sep 01 00:33:44.616719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 244/478] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:44 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:44.622727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:44.631912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9fc46c6a-ee68-4930-a301-108cff40e525 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1682 microversion: 2.1 time: 0.157202 Sep 01 00:33:44.634534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 235/479] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:44 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:45.210591 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:45.211193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:45.217860 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:45.218335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:45.218762 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:45.219444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:45.219888 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:45.220307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:45.283727 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:45.291670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:45.293134 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:45.294218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1a63fec5-33f5-48ed-af87-67604f23b569 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1276 microversion: 2.20 time: 0.088058 Sep 01 00:33:45.294880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 245/480] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:45 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:45.637834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:45.638436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:45.644865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:45.645342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:45.645772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:45.646764 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:45.647216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:45.647635 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:45.655749 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:45.656351 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:45.662822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:45.663304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:45.663741 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:45.664435 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:45.664910 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:45.665330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:45.783341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:45.791785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5d505cf7-5114-4a9e-96e3-c3ec4b713cc8 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1721 microversion: 2.1 time: 0.157836 Sep 01 00:33:45.792353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 236/481] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:45 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:45.798180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:45.806486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6a502384-12af-4188-bf6c-ca6d129e0825 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1682 microversion: 2.1 time: 0.154524 Sep 01 00:33:45.807047 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 246/482] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:45 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:33:46.316716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:46.317318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:46.323728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:46.324202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:46.324666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:46.325344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:46.325790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:46.326208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:46.386788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:46.394618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:46.396041 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:46.397173 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-62855eb5-3dce-4b5c-a51b-ad1f03488184 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1276 microversion: 2.20 time: 0.084491 Sep 01 00:33:46.397723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 237/483] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:46 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1276 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:46.814187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:46.814885 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:46.821667 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:46.822941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:46.823604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:46.824547 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:46.825209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:46.825707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:46.829335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:46.830750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:46.838633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:46.839114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:46.839764 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:46.840541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:46.841174 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:46.841879 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:46.976619 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:46.984867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b816c0bd-4ba3-463a-8201-6e845269f4cb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1727 microversion: 2.1 time: 0.175674 Sep 01 00:33:46.985439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 247/484] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:46 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:47.004754 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:47.005242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:47.011822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:47.012304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:47.012786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:47.013471 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:47.013916 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:47.014332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:47.092107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2170839a-9df5-4acb-89a8-c4205eb628fc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091046 Sep 01 00:33:47.092730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 248/485] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:33:46 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:33:47.100701 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:47.108426 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b1b8d75d-7478-4bbb-9882-ece610982c2f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1682 microversion: 2.1 time: 0.285020 Sep 01 00:33:47.109022 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 238/486] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:46 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1682 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:47.419665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:47.420266 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:47.428863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:47.429366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:47.429797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:47.430516 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:47.430968 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:47.431384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:47.500587 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:47.509178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:47.510654 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:47.512373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0b0ca4f0-9dcc-4dfa-9312-fd74cce854ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1338 microversion: 2.20 time: 0.096595 Sep 01 00:33:47.526715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 249/487] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:47 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:48.133038 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:48.134572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:48.141267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:48.142189 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:48.142799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:48.147882 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:48.148628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:48.149221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:48.182982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-5643ebd5-0e1b-4080-b42f-73d1882e36b4 req-55153dca-9b7f-4d5e-b62b-4aa271460cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ed76d3a-7638-4a6e-b229-054bd6f51d89", "name": "network-vif-deleted", "tag": "9c25cd75-9b62-4d21-a2e4-5125ad46047f"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:48.207890 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-5643ebd5-0e1b-4080-b42f-73d1882e36b4 req-55153dca-9b7f-4d5e-b62b-4aa271460cc6 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:48.208287 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-5643ebd5-0e1b-4080-b42f-73d1882e36b4 req-55153dca-9b7f-4d5e-b62b-4aa271460cc6 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:48.209318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-5643ebd5-0e1b-4080-b42f-73d1882e36b4 req-55153dca-9b7f-4d5e-b62b-4aa271460cc6 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:48.243257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-5643ebd5-0e1b-4080-b42f-73d1882e36b4 req-55153dca-9b7f-4d5e-b62b-4aa271460cc6 service nova] Creating event network-vif-deleted:9c25cd75-9b62-4d21-a2e4-5125ad46047f for instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 on hv-cinder-82002 Sep 01 00:33:48.270343 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:48.276637 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-5643ebd5-0e1b-4080-b42f-73d1882e36b4 req-55153dca-9b7f-4d5e-b62b-4aa271460cc6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081944 Sep 01 00:33:48.278569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 250/488] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:48.284472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bf94909e-d1f5-41d5-9855-7c696ea5a46d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 200 len: 1614 microversion: 2.1 time: 0.158239 Sep 01 00:33:48.289065 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 239/489] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:48 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 1614 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:48.542292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:48.545264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:48.561668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:48.562569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:48.564723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:48.567909 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:48.568780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:48.571351 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:48.847859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:48.859577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:48.861511 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:48.863236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f19135f6-fcae-4751-97aa-06ff65ebf819 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.331723 Sep 01 00:33:48.878358 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 251/490] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:48 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:48.959261 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-ae9c644d-33c6-4eb3-bb65-65671a71d18d req-a6eb202c-b3a2-4629-8a90-af26d75f650b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:48.969924 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ae9c644d-33c6-4eb3-bb65-65671a71d18d req-a6eb202c-b3a2-4629-8a90-af26d75f650b service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:48.970704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ae9c644d-33c6-4eb3-bb65-65671a71d18d req-a6eb202c-b3a2-4629-8a90-af26d75f650b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:48.971286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-ae9c644d-33c6-4eb3-bb65-65671a71d18d req-a6eb202c-b3a2-4629-8a90-af26d75f650b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:48.985988 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-ae9c644d-33c6-4eb3-bb65-65671a71d18d req-a6eb202c-b3a2-4629-8a90-af26d75f650b service nova] Creating event network-changed:6ad399c9-2cb1-4999-8111-29a8364f2345 for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 on hv-cinder-82002 Sep 01 00:33:48.992563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-ae9c644d-33c6-4eb3-bb65-65671a71d18d req-a6eb202c-b3a2-4629-8a90-af26d75f650b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037314 Sep 01 00:33:48.993696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 240/491] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:49.309883 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:49.311257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:49.318984 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:49.319865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:49.320372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:49.321210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:49.321832 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:49.322347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:49.354937 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 HTTP/1.1 Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:33:49.364276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:33:49.367413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '1ed76d3a-7638-4a6e-b229-054bd6f51d89'} Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:33:49.368267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:33:49.371677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:33:49.374238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:33:49.375362 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-21ca2e9a-dbc3-46be-a0bb-2296750d479f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 404 len: 111 microversion: 2.1 time: 0.069339 Sep 01 00:33:49.375957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 252/492] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:49 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:33:49.388391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b206cbc4-2646-4f85-a553-1574f79515bf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '.version_select at 0x7fcadfdac940>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:49.419287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b206cbc4-2646-4f85-a553-1574f79515bf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584182130" status: 202 len: 0 microversion: 2.1 time: 0.037048 Sep 01 00:33:49.420716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 241/493] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 00:33:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1584182130 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:49.886129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:49.886743 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:49.892808 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:49.893293 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:49.893731 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:49.894433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:49.894932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:49.895360 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:50.137491 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:50.145604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:50.147854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:50.149903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-202145d2-648d-48c5-ab4e-b523498a7f87 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.267427 Sep 01 00:33:50.151071 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 253/494] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:49 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:50.297104 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abf8d128-7684-4263-babf-222cc0beae80", "tag": "54ed4609-29d2-46df-968c-532a898d8333"}, {"name": "network-changed", "server_uuid": "abf8d128-7684-4263-babf-222cc0beae80", "tag": "54ed4609-29d2-46df-968c-532a898d8333"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:50.309634 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:50.310115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:50.310543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:50.321868 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] Creating event network-changed:54ed4609-29d2-46df-968c-532a898d8333 for instance abf8d128-7684-4263-babf-222cc0beae80 on hv-cinder-82002 Sep 01 00:33:50.322374 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] Creating event network-changed:54ed4609-29d2-46df-968c-532a898d8333 for instance abf8d128-7684-4263-babf-222cc0beae80 on hv-cinder-82002 Sep 01 00:33:50.327318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-0150cadc-cc8a-49be-84af-ac9d24bc0a19 req-9ca520c1-28e3-4844-a534-04c320537386 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033943 Sep 01 00:33:50.327915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 242/495] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:50.374099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:50.374649 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:50.381020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:50.381501 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:50.381928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:50.382611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:50.383054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:50.383472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:50.465747 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lazy-loading 'services' on Instance uuid d50b662a-3c38-40f3-92b5-37f693b80d25 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:33:50.541465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6c47df3a-c488-4ecd-9475-d5ddb8da1a12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments/f35c34b6-212d-4b2b-9caa-67988aaf9a16" status: 202 len: 0 microversion: 2.1 time: 0.171113 Sep 01 00:33:50.541969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 254/496] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:33:50 2022] DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments/f35c34b6-212d-4b2b-9caa-67988aaf9a16 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:50.551706 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:50.554041 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:50.560188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:50.560714 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:50.561148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:50.561832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:50.562278 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:50.562708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:50.592759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-aa9788a6-2f2e-459d-b268-af1d577c4a10 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045905 Sep 01 00:33:50.593311 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 243/497] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:33:50 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:51.175542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:51.176320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:51.183381 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:51.183889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:51.184316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:51.185035 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:51.185479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:51.185930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:51.335423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:51.343568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:51.345080 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:51.346207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1dd73466-ad13-4c81-b664-fdbb735ce310 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.175463 Sep 01 00:33:51.346763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 255/498] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:51 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:51.604617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:51.606731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:51.609121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:51.614384 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:51.615516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:51.615949 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:51.616675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:51.617120 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:51.617542 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:51.652610 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4f829396-e229-408c-a768-92f1934f4e9f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051873 Sep 01 00:33:51.653190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 244/499] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:33:51 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:52.369257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:52.369962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:52.376707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.377198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.377636 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.378335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.378788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.379213 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.595218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:52.603477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:52.604938 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:52.606022 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-caafd2de-c9ba-4d49-97c4-feb4d9987262 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.241452 Sep 01 00:33:52.606577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 256/500] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:52 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:52.664737 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:52.666901 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:52.673982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.674471 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.674910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.675699 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.676152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.676605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.707543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-817e7b9c-d7bd-4b2e-8782-906d3cf996c7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046710 Sep 01 00:33:52.708455 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 245/501] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:33:52 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:33:52.778712 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:52.779204 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:52.785166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.785669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.786101 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.787313 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.787760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.788174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.812605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:33:52.887454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ae897f7b-da16-4857-bbc1-4bf40791981d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 204 len: 0 microversion: 2.1 time: 0.112277 Sep 01 00:33:52.888177 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 257/502] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:33:52 2022] DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:33:52.896860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:52.897465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:52.903277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.903751 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.904180 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.904898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:52.905337 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:52.905749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:52.923630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:52.947830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:53.038958 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:53.046604 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d9664a02-d564-4434-a6ef-9c7daa8c92f7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1682 microversion: 2.1 time: 0.153645 Sep 01 00:33:53.047163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 246/503] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:52 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:53.629852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:53.630690 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:53.635060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:53.640736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:53.641229 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:53.641664 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:53.642366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:53.642815 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:53.643239 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:53.648117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:53.781085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:53.789533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:53.790960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:53.792059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-01b06a91-cb25-4dfd-b862-b7af0d31fca6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.167000 Sep 01 00:33:53.792633 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 258/504] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:53 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:54.069334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:54.069943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:54.076303 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:54.076918 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:54.077361 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:54.078044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:54.078771 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:54.079189 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:54.212431 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:54.220667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-199d456c-ec77-4242-a669-7f0e3c6620c5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1682 microversion: 2.1 time: 0.155123 Sep 01 00:33:54.221247 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 247/505] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:54 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:54.814765 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:54.815379 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:54.822956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:54.823448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:54.823891 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:54.824624 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:54.825083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:54.825510 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:55.092826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:55.101169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:55.102561 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:55.103662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4ad1bb97-242e-4e49-85ae-8f1ff4c44ecb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.292802 Sep 01 00:33:55.104207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 259/506] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:54 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:55.243272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:55.243882 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:55.252881 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:55.253371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:55.253805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:55.254752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:55.255919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:55.256362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:55.325279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:55.333936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b67cd5dc-9863-441a-a90a-962b2205726e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1615 microversion: 2.1 time: 0.094002 Sep 01 00:33:55.334706 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 248/507] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:55 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1615 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:55.563721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-f4829296-91a5-4cb8-8295-b7b1a6ab84b7 req-adb15cd6-597c-4b59-9b5b-cf005b156f51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50b662a-3c38-40f3-92b5-37f693b80d25", "name": "network-vif-deleted", "tag": "299fe693-858d-4ad5-9a80-e1369ca617bf"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:55.574101 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:55.579775 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f4829296-91a5-4cb8-8295-b7b1a6ab84b7 req-adb15cd6-597c-4b59-9b5b-cf005b156f51 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:55.580448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f4829296-91a5-4cb8-8295-b7b1a6ab84b7 req-adb15cd6-597c-4b59-9b5b-cf005b156f51 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:55.581006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f4829296-91a5-4cb8-8295-b7b1a6ab84b7 req-adb15cd6-597c-4b59-9b5b-cf005b156f51 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:55.595726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-f4829296-91a5-4cb8-8295-b7b1a6ab84b7 req-adb15cd6-597c-4b59-9b5b-cf005b156f51 service nova] Creating event network-vif-deleted:299fe693-858d-4ad5-9a80-e1369ca617bf for instance d50b662a-3c38-40f3-92b5-37f693b80d25 on hv-cinder-82002 Sep 01 00:33:55.601541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-f4829296-91a5-4cb8-8295-b7b1a6ab84b7 req-adb15cd6-597c-4b59-9b5b-cf005b156f51 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041612 Sep 01 00:33:55.602402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 260/508] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:55.837190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-80ca7c31-3b0f-4722-9957-91c5622ecc18 req-33d05695-974a-4f4d-aeda-44055cf6d031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "name": "network-vif-plugged", "status": "completed", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:55.846992 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-80ca7c31-3b0f-4722-9957-91c5622ecc18 req-33d05695-974a-4f4d-aeda-44055cf6d031 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:55.847726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-80ca7c31-3b0f-4722-9957-91c5622ecc18 req-33d05695-974a-4f4d-aeda-44055cf6d031 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:55.848309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-80ca7c31-3b0f-4722-9957-91c5622ecc18 req-33d05695-974a-4f4d-aeda-44055cf6d031 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:55.864320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-80ca7c31-3b0f-4722-9957-91c5622ecc18 req-33d05695-974a-4f4d-aeda-44055cf6d031 service nova] Creating event network-vif-plugged:6ad399c9-2cb1-4999-8111-29a8364f2345 for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 on hv-cinder-82002 Sep 01 00:33:55.871599 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-80ca7c31-3b0f-4722-9957-91c5622ecc18 req-33d05695-974a-4f4d-aeda-44055cf6d031 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038106 Sep 01 00:33:55.872162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 249/509] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:56.127068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:56.127993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:56.136406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:56.136996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:56.137522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:56.138405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:56.138927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:56.139418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:56.276615 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:56.284915 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:56.286387 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:56.287548 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d703fd81-0578-4279-b492-4e6183f9f7a4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.165344 Sep 01 00:33:56.288098 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 261/510] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:56 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:56.357791 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:56.358498 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:56.366231 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:56.366720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:56.367324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:56.368885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:56.369472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:56.370221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:56.375222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:33:56.408390 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:56.408984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:56.409527 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:56.409981 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lazy-loading 'fault' on Instance uuid d50b662a-3c38-40f3-92b5-37f693b80d25 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:33:56.457109 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:56.464914 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ecb7e0db-3765-4496-8ca2-38c1816f229f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 200 len: 1332 microversion: 2.1 time: 0.112724 Sep 01 00:33:56.465472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 250/511] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:56 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 1332 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:33:57.313464 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:57.314103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:57.320522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:57.321013 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:57.321452 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:57.322145 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:57.322595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:57.323019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:57.453991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:57.462269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:57.463747 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:57.464880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-55766b68-083e-48db-91bc-3d11503f2b13 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1406 microversion: 2.20 time: 0.155327 Sep 01 00:33:57.465435 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 262/512] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:57 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:57.486273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:57.486979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:57.494171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:57.494661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:57.495104 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:57.495804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:57.496259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:57.496781 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:57.511054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 HTTP/1.1 Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:33:57.512722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:33:57.514221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'd50b662a-3c38-40f3-92b5-37f693b80d25'} Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:33:57.515166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:33:57.516631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:33:57.518157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:33:57.518157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bb06085d-2f81-499e-b14e-6d1e8a7542bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 404 len: 111 microversion: 2.1 time: 0.031753 Sep 01 00:33:57.518157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 251/513] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:57 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:33:57.523135 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6e770b0f-2a6e-4b98-bc44-5be8c5d02f67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '.version_select at 0x7fcadfe7ddc0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:57.541422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6e770b0f-2a6e-4b98-bc44-5be8c5d02f67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084636291" status: 202 len: 0 microversion: 2.1 time: 0.022327 Sep 01 00:33:57.541992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 263/514] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 00:33:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2084636291 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:33:58.171465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cb2641af-5308-4d5d-b7ea-e8a093dadc66 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: .version_select at 0x7fcadfec0550>, body: {"keypair": {"name": "tempest-keypair-1148936130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNp+1EqfRUHc5E+bKwNMRdfp1TKPIwV3i/J0lqrbo9fUp+NyM69+7g6LrvRJiC2tCZGU5GhzBQz1637m2DHFKo1Cu26cqznoXAq0uN4tDV1P6NLEPkQWT7ptFQmd+h86gA=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:33:58.187275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-cb2641af-5308-4d5d-b7ea-e8a093dadc66 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:33:58.191196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-cb2641af-5308-4d5d-b7ea-e8a093dadc66 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:33:58.216176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cb2641af-5308-4d5d-b7ea-e8a093dadc66 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048706 Sep 01 00:33:58.216919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 252/515] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:33:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:33:58.488567 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:58.489388 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:58.495838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:58.496411 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:58.496936 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:58.497705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:58.498247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:58.498739 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:58.684397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:58.693128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:58.694792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:33:58.696089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3862b2b6-1eff-496a-a4aa-5f73c2ada4d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1598 microversion: 2.20 time: 0.212512 Sep 01 00:33:58.696760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 264/516] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:33:58 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1598 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:33:58.720100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:58.720743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:58.728090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:58.728633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:58.729078 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:58.730872 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:58.731341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:58.731801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:58.833388 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1c2f8125-eae5-433f-bbfe-12f9bffb3b48 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.117652 Sep 01 00:33:58.834190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 253/517] 10.222.0.25 () {60 vars in 1316 bytes} [Thu Sep 1 00:33:58 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:33:59.713989 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:59.717708 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:59.724641 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:59.725138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:59.725581 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:59.726302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:59.726813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:59.727313 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:59.756951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bceb1905-9a5f-4d3c-81f4-72e11d6bc09b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049917 Sep 01 00:33:59.757513 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 265/518] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:33:59 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 00:33:59.820835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:59.821414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:59.827401 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:59.827886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:59.828610 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:59.829308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:59.829765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:59.830192 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:59.856123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:33:59.935551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-34157ec0-fd87-486b-bb84-348241963a57 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 204 len: 0 microversion: 2.1 time: 0.119322 Sep 01 00:33:59.939173 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 254/519] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:33:59 2022] DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:33:59.945404 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:33:59.946325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:33:59.952334 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:59.953373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:59.953816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:33:59.954586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:33:59.954983 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:33:59.955415 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:00.086145 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:00.093888 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6956e7b2-6898-47de-9e06-bdc48824eee2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1675 microversion: 2.1 time: 0.153301 Sep 01 00:34:00.094456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 266/520] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:33:59 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:00.576236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-242053741", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c58401f2-7e87-4905-8554-61c4ec2b1ce1"}], "security_groups": [{"name": "tempest-securitygroup--1338166162"}], "key_name": "tempest-keypair-1148936130", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:00.584835 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-dfbeebc6-8569-4644-a209-8fa8fc16842f req-5d6fbfe9-710b-4144-bb98-5566900c087f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:00.594286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-dfbeebc6-8569-4644-a209-8fa8fc16842f req-5d6fbfe9-710b-4144-bb98-5566900c087f service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:00.594756 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-dfbeebc6-8569-4644-a209-8fa8fc16842f req-5d6fbfe9-710b-4144-bb98-5566900c087f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:00.595184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-dfbeebc6-8569-4644-a209-8fa8fc16842f req-5d6fbfe9-710b-4144-bb98-5566900c087f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:00.607743 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-dfbeebc6-8569-4644-a209-8fa8fc16842f req-5d6fbfe9-710b-4144-bb98-5566900c087f service nova] Creating event network-changed:6ad399c9-2cb1-4999-8111-29a8364f2345 for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 on hv-cinder-82002 Sep 01 00:34:00.614883 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-dfbeebc6-8569-4644-a209-8fa8fc16842f req-5d6fbfe9-710b-4144-bb98-5566900c087f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034000 Sep 01 00:34:00.616110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 267/521] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:00.691624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] validate_networks() for [('c58401f2-7e87-4905-8554-61c4ec2b1ce1', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:34:01.070987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:34:01.071555 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:34:01.071864 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:34:01.072269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:34:01.072727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:34:01.081827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:01.082301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:01.082732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:01.083590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:01.084039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:01.084466 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:01.101722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:34:01.105656 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:34:01.117637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:34:01.119693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:01.120193 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:34:01.120397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:01.126715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:01.127204 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:01.127774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:01.128478 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:01.128952 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:01.129377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:01.169190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6f90a495-7dae-4ffe-b514-afa0471a73c6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.598319 Sep 01 00:34:01.169844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 255/522] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:34:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:34:01.181402 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-74c2fdc5-530c-47e4-9add-ab932fa355d2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:01.182252 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-74c2fdc5-530c-47e4-9add-ab932fa355d2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:01.247265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-74c2fdc5-530c-47e4-9add-ab932fa355d2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:01.256430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-74c2fdc5-530c-47e4-9add-ab932fa355d2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1241 microversion: 2.1 time: 0.079740 Sep 01 00:34:01.257498 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 256/523] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:01 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:01.308688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:01.316386 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ee806321-9b12-412f-8e1f-b89ed4fc547b tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1675 microversion: 2.1 time: 0.202790 Sep 01 00:34:01.316993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 268/524] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:01 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1675 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:34:02.277096 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:02.277765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:02.284442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:02.284969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:02.285413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:02.286161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:02.286616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:02.287240 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:02.339296 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:02.339940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:02.347324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:02.348260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:02.348830 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:02.349815 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:02.350283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:02.350719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:02.393647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:02.404320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-951d1753-d065-4a49-b511-d485efb213d5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1293 microversion: 2.1 time: 0.130929 Sep 01 00:34:02.405815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 257/525] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:02 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1293 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:34:02.575255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:02.584762 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b3bd1768-a96d-4be1-aff6-74de2d78d100 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1675 microversion: 2.1 time: 0.249287 Sep 01 00:34:02.585349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 269/526] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:02 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1675 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:34:03.185651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-945b743f-7727-44ed-8651-8aa308374daf req-7601187a-6291-4c70-876c-0e3254101c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f8ee3b6-8801-4650-8819-1587d9da7d98", "name": "network-vif-deleted", "tag": "0c45dd3f-1c4e-4370-83b2-adc0f7df081b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:03.200355 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-945b743f-7727-44ed-8651-8aa308374daf req-7601187a-6291-4c70-876c-0e3254101c3f service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:03.201319 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-945b743f-7727-44ed-8651-8aa308374daf req-7601187a-6291-4c70-876c-0e3254101c3f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:03.201455 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-945b743f-7727-44ed-8651-8aa308374daf req-7601187a-6291-4c70-876c-0e3254101c3f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:03.217070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-945b743f-7727-44ed-8651-8aa308374daf req-7601187a-6291-4c70-876c-0e3254101c3f service nova] Creating event network-vif-deleted:0c45dd3f-1c4e-4370-83b2-adc0f7df081b for instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 on hv-cinder-82002 Sep 01 00:34:03.223045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-945b743f-7727-44ed-8651-8aa308374daf req-7601187a-6291-4c70-876c-0e3254101c3f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044688 Sep 01 00:34:03.224903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 258/527] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:03.429906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:03.430711 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:03.437716 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:03.438296 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:03.438803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:03.439742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:03.440389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:03.441026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:03.571254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:03.580937 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-180c8450-b772-4133-8af9-f07e114b1374 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1299 microversion: 2.1 time: 0.156280 Sep 01 00:34:03.582075 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 270/528] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:03 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1299 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:03.609990 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:03.611244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:03.621113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:03.621858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:03.622529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:03.623265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:03.623728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:03.624153 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:03.661888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:03.662376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:03.662806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:03.663443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lazy-loading 'fault' on Instance uuid 5f8ee3b6-8801-4650-8819-1587d9da7d98 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:03.727245 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:03.742122 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-11df7c3a-92f1-4d52-87e8-70032150048c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 200 len: 1328 microversion: 2.1 time: 0.139442 Sep 01 00:34:03.743636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 259/529] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:03 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 1328 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:04.519120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-2c2b5111-0d6a-4200-8143-aecc940ac465 req-3e71ed43-444f-4a14-b0e8-8f66cb8ca143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd521ac-53c1-4789-94b2-c2fd1fa62bf5", "tag": "485c34a1-1789-4ff4-a713-f780bd540db1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:04.529627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-2c2b5111-0d6a-4200-8143-aecc940ac465 req-3e71ed43-444f-4a14-b0e8-8f66cb8ca143 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:04.530838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-2c2b5111-0d6a-4200-8143-aecc940ac465 req-3e71ed43-444f-4a14-b0e8-8f66cb8ca143 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:04.530838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-2c2b5111-0d6a-4200-8143-aecc940ac465 req-3e71ed43-444f-4a14-b0e8-8f66cb8ca143 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:04.542305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-2c2b5111-0d6a-4200-8143-aecc940ac465 req-3e71ed43-444f-4a14-b0e8-8f66cb8ca143 service nova] Creating event network-changed:485c34a1-1789-4ff4-a713-f780bd540db1 for instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 on hv-cinder-82002 Sep 01 00:34:04.547622 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-2c2b5111-0d6a-4200-8143-aecc940ac465 req-3e71ed43-444f-4a14-b0e8-8f66cb8ca143 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032384 Sep 01 00:34:04.548225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 271/530] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:04.602392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:04.603000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:04.609086 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:04.609564 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:04.609993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:04.610685 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:04.611227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:04.611526 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:04.751240 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:04.759729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f5f34fd2-1fe8-4e5f-a3e8-4ec3369aff12 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.161082 Sep 01 00:34:04.772539 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 260/531] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:04 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:04.772750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:04.772750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:04.772750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:04.772750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:04.773102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:04.773197 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:04.773597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:04.774224 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:04.788111 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] HTTP exception thrown: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Request method failure captured: Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 HTTP/1.1 Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0J-vJwsVD3eft6GqCWnwo7JtP5tTJmT_SAiipg32jw8Eor-eeW4-__i6UYppgOVuDYe_B1I2GV-vTypzKC444cvfJgh9RX6eS3T6_gBVvutRZK-gCFqAqb127LLNNSA7aUAoMY1v-lumzkbii_2aEoWfWQP0rAPiAIXhdcEFN8Acc Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:34:04.789802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}] Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 5bf265cb4af14e2d8815c42288e2a1f7 Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:34:04.791451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '5f8ee3b6-8801-4650-8819-1587d9da7d98'} Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:34:04.792401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:34:04.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:34:04.795285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Returning 404 to user: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:34:04.795285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-40a7e42b-78e5-4ef3-8e78-45c19992248c tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 404 len: 111 microversion: 2.1 time: 0.032368 Sep 01 00:34:04.795285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 272/532] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:04 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:34:04.801043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-539f10af-850f-4bd2-9d25-25b773ca2ffa tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '.version_select at 0x7fcadfe48ee0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:04.820248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-539f10af-850f-4bd2-9d25-25b773ca2ffa tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104154925" status: 202 len: 0 microversion: 2.1 time: 0.023083 Sep 01 00:34:04.820881 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 261/533] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 00:34:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2104154925 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:34:05.679293 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d9068417-ce8d-4576-9e0d-abbb95a7d56d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: .version_select at 0x7fcadfdfcb80>, body: {"keypair": {"name": "tempest-keypair-1805661980", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK11XquoLFgrvolNQS8ZuvqGyFOzRgWV9Oz9gnIETgOKOYPwssZqgNmNQNHmPoS/1Y+e0HtmKE3kqMwDv0H3BXGGevjQPRkuMPlHvOzHe7m/9N7vr68NKn+yVP/qXFhEhg=="}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:05.696013 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-d9068417-ce8d-4576-9e0d-abbb95a7d56d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for project f1064fc209674020b54fa7526cf22bf5. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:34:05.700099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-d9068417-ce8d-4576-9e0d-abbb95a7d56d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for user 5bf265cb4af14e2d8815c42288e2a1f7 and project f1064fc209674020b54fa7526cf22bf5. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:34:05.722027 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d9068417-ce8d-4576-9e0d-abbb95a7d56d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047317 Sep 01 00:34:05.722657 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 273/534] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:34:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:05.783282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:05.784516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:05.791063 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:05.791543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:05.791980 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:05.792708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:05.793317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:05.793817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:05.936981 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:05.945409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b667965c-e383-439c-8a0e-cd8a7e4637fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.166449 Sep 01 00:34:05.946235 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 262/535] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:05 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:06.967700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:06.968326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:06.975654 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:06.976147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:06.976613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:06.977323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:06.977780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:06.978208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:07.109566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1218000822", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a7ae7c87-2d4d-4921-9c18-8673416a29fc"}], "security_groups": [{"name": "tempest-securitygroup--2056626306"}], "key_name": "tempest-keypair-1805661980", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:07.114380 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:07.122524 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-31b8b100-6f64-467d-8882-5218037f6303 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.159167 Sep 01 00:34:07.123103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 274/536] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:06 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:07.211911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] validate_networks() for [('a7ae7c87-2d4d-4921-9c18-8673416a29fc', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:34:07.587422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:34:07.587839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:34:07.588358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:34:07.588789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:34:07.589197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:34:07.597945 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:07.598486 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:07.599007 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:07.599726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:07.600172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:07.600620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:07.616885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for project f1064fc209674020b54fa7526cf22bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:34:07.620768 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Getting quotas for user 5bf265cb4af14e2d8815c42288e2a1f7 and project f1064fc209674020b54fa7526cf22bf5. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:34:07.632155 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:34:07.634424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:34:07.682305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4c6919ef-22ae-4109-9590-eab1ff3ee627 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.576981 Sep 01 00:34:07.682954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 263/537] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:34:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:34:07.694327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d9b2cf8f-641e-4a57-bd84-a52deab4483e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:07.695208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d9b2cf8f-641e-4a57-bd84-a52deab4483e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:07.767935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d9b2cf8f-641e-4a57-bd84-a52deab4483e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:07.777760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d9b2cf8f-641e-4a57-bd84-a52deab4483e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1238 microversion: 2.1 time: 0.087417 Sep 01 00:34:07.778795 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 275/538] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:07 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:08.144323 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:08.145279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:08.151794 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:08.152270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:08.152731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:08.153420 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:08.153866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:08.154298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:08.304465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:08.312800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1c85da64-af29-43ae-a4bc-c9588204b68f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.173570 Sep 01 00:34:08.313787 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 264/539] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:08 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:08.800764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:08.801937 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:08.808019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:08.809113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:08.809553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:08.810458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:08.810931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:08.811345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:08.879096 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:08.887126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ef5035be-fa1f-4af5-a919-5512c406dd34 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1290 microversion: 2.1 time: 0.090797 Sep 01 00:34:08.887896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 276/540] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:08 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:09.334237 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:09.334840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:09.342028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:09.342729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:09.343170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:09.343962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:09.344413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:09.344886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:09.481795 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:09.489805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8eda5b57-5210-481a-b33c-aa99a7299ae5 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.159489 Sep 01 00:34:09.490377 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 265/541] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:09 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:09.883091 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-d2b7d30f-c226-4a93-9b37-474156024348 req-0a6300d9-8e6e-4601-8746-5c94d925412c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd521ac-53c1-4789-94b2-c2fd1fa62bf5", "name": "network-vif-plugged", "status": "completed", "tag": "485c34a1-1789-4ff4-a713-f780bd540db1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:09.896826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-d2b7d30f-c226-4a93-9b37-474156024348 req-0a6300d9-8e6e-4601-8746-5c94d925412c service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:09.897312 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-d2b7d30f-c226-4a93-9b37-474156024348 req-0a6300d9-8e6e-4601-8746-5c94d925412c service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:09.897921 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-d2b7d30f-c226-4a93-9b37-474156024348 req-0a6300d9-8e6e-4601-8746-5c94d925412c service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:09.909493 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:09.911276 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:09.913883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:09.930322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:09.930595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:09.932441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:09.935063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-d2b7d30f-c226-4a93-9b37-474156024348 req-0a6300d9-8e6e-4601-8746-5c94d925412c service nova] Creating event network-vif-plugged:485c34a1-1789-4ff4-a713-f780bd540db1 for instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 on hv-cinder-82002 Sep 01 00:34:09.937830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:09.938316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:09.938756 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:09.944969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-d2b7d30f-c226-4a93-9b37-474156024348 req-0a6300d9-8e6e-4601-8746-5c94d925412c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066644 Sep 01 00:34:09.946073 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 277/542] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:10.097238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:10.106405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e75d0f5a-6891-4beb-a855-712b61dd0747 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.202338 Sep 01 00:34:10.107296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 266/543] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:09 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:10.310659 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-e50ef756-4e58-491c-a300-47cf238c0820 req-de738d28-9994-4a3c-b35f-b562d633bccd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afcd12a5-5d5a-4b6e-868e-06353c107d8d", "tag": "6e1784d4-2cf5-4a72-8d15-fe2c896999f1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:10.321064 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e50ef756-4e58-491c-a300-47cf238c0820 req-de738d28-9994-4a3c-b35f-b562d633bccd service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:10.321532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e50ef756-4e58-491c-a300-47cf238c0820 req-de738d28-9994-4a3c-b35f-b562d633bccd service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:10.321979 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e50ef756-4e58-491c-a300-47cf238c0820 req-de738d28-9994-4a3c-b35f-b562d633bccd service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:10.333160 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-e50ef756-4e58-491c-a300-47cf238c0820 req-de738d28-9994-4a3c-b35f-b562d633bccd service nova] Creating event network-changed:6e1784d4-2cf5-4a72-8d15-fe2c896999f1 for instance afcd12a5-5d5a-4b6e-868e-06353c107d8d on hv-cinder-82002 Sep 01 00:34:10.337904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-e50ef756-4e58-491c-a300-47cf238c0820 req-de738d28-9994-4a3c-b35f-b562d633bccd service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031219 Sep 01 00:34:10.338489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 278/544] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:10.511048 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:10.511696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:10.518020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:10.518496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:10.518928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:10.519610 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:10.520817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:10.521237 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:10.651668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:10.659232 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-45c6fa8b-454f-4e50-9b3a-7f252c28ac32 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.152068 Sep 01 00:34:10.659786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 267/545] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:10 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:11.128293 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:11.129089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:11.136486 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:11.136992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:11.137426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:11.138137 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:11.138594 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:11.139050 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:11.369480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:11.380892 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-14bdc6b6-bdbb-4729-85ae-320c0a0aaa00 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.257203 Sep 01 00:34:11.382254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 279/546] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:11 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:11.679628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:11.680233 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:11.686591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:11.687069 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:11.687500 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:11.688183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:11.688662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:11.689084 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:11.818663 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:11.826397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5d36686a-28b0-4343-9a12-409de3df251e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1367 microversion: 2.1 time: 0.150805 Sep 01 00:34:11.826815 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 268/547] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:11 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:12.402503 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:12.403119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:12.409540 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:12.410024 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:12.411589 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:12.412310 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:12.412802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:12.413235 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:12.543627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:12.551349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6b057197-16b9-4d38-9ebb-0c5d029e0d18 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.152635 Sep 01 00:34:12.551912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 280/548] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:12 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:12.847256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:12.848397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:12.854415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:12.854884 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:12.855322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:12.856012 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:12.856468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:12.856923 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:12.987310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:12.995804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-228cf8aa-be97-4f8b-95f6-7c5bdc74f870 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1557 microversion: 2.1 time: 0.152626 Sep 01 00:34:12.996375 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 269/549] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:12 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:13.022761 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:13.023255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:13.029091 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:13.029571 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:13.030000 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:13.030684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:13.031129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:13.031548 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:13.107260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8a421175-7748-45c1-94a2-7b0ae6a662bb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095575 Sep 01 00:34:13.107840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 281/550] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:34:13 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:13.571439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:13.572173 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:13.578287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:13.578762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:13.579190 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:13.579872 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:13.580318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:13.580764 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:13.596065 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:14.050495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:14.058165 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-26384a77-171c-4e8d-8128-c00cab544f4d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.490716 Sep 01 00:34:14.059054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 270/551] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:13 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:14.354781 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-36aef455-2a84-4404-a64a-63ed60eb8340 req-3d91cd14-007d-4038-a12d-5efe5ce93c32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ddd521ac-53c1-4789-94b2-c2fd1fa62bf5", "tag": "485c34a1-1789-4ff4-a713-f780bd540db1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:14.364171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-36aef455-2a84-4404-a64a-63ed60eb8340 req-3d91cd14-007d-4038-a12d-5efe5ce93c32 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:14.364680 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-36aef455-2a84-4404-a64a-63ed60eb8340 req-3d91cd14-007d-4038-a12d-5efe5ce93c32 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:14.365110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-36aef455-2a84-4404-a64a-63ed60eb8340 req-3d91cd14-007d-4038-a12d-5efe5ce93c32 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:14.367906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=100 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:14.377983 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-36aef455-2a84-4404-a64a-63ed60eb8340 req-3d91cd14-007d-4038-a12d-5efe5ce93c32 service nova] Creating event network-changed:485c34a1-1789-4ff4-a713-f780bd540db1 for instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 on hv-cinder-82002 Sep 01 00:34:14.383533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-36aef455-2a84-4404-a64a-63ed60eb8340 req-3d91cd14-007d-4038-a12d-5efe5ce93c32 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032943 Sep 01 00:34:14.384348 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 282/552] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:15.079087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:15.079797 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:15.086382 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:15.086942 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:15.087447 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:15.088208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:15.088760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:15.089250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:15.224261 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:15.232621 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-025c36ae-f8db-494f-9195-654f6e3f8dd7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.157613 Sep 01 00:34:15.233495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 271/553] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:15 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:16.256156 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:16.256987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:16.263046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:16.263525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:16.263960 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:16.264678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:16.265132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:16.265561 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:16.403962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:16.411617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f2668464-9125-40b9-8e63-5cbe2d9291c2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.161276 Sep 01 00:34:16.412175 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 283/554] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:16 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:17.432712 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:17.433320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:17.440755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:17.441230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:17.441745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:17.442429 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:17.442877 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:17.443292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:17.572227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:17.580000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-37fe4491-0b4a-430c-a57c-5c1561999113 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.151228 Sep 01 00:34:17.580691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 272/555] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:17 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:17.905737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-065a69e4-bfa4-4204-941b-93ddb2730c7d req-70f7b166-754c-4f85-b1d1-cb3a4aa9223d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afcd12a5-5d5a-4b6e-868e-06353c107d8d", "name": "network-vif-plugged", "status": "completed", "tag": "6e1784d4-2cf5-4a72-8d15-fe2c896999f1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:17.912209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:17.918269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-065a69e4-bfa4-4204-941b-93ddb2730c7d req-70f7b166-754c-4f85-b1d1-cb3a4aa9223d service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:17.918751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-065a69e4-bfa4-4204-941b-93ddb2730c7d req-70f7b166-754c-4f85-b1d1-cb3a4aa9223d service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:17.919184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-065a69e4-bfa4-4204-941b-93ddb2730c7d req-70f7b166-754c-4f85-b1d1-cb3a4aa9223d service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:17.931026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-065a69e4-bfa4-4204-941b-93ddb2730c7d req-70f7b166-754c-4f85-b1d1-cb3a4aa9223d service nova] Creating event network-vif-plugged:6e1784d4-2cf5-4a72-8d15-fe2c896999f1 for instance afcd12a5-5d5a-4b6e-868e-06353c107d8d on hv-cinder-82002 Sep 01 00:34:17.935768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-065a69e4-bfa4-4204-941b-93ddb2730c7d req-70f7b166-754c-4f85-b1d1-cb3a4aa9223d service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033695 Sep 01 00:34:17.936352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 284/556] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:18.604537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:18.605181 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:18.607045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:18.607699 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=18 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:18.614377 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:18.614866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:18.615302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:18.615995 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:18.616454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:18.617033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:18.745187 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:18.752666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7ea06d01-9274-4699-b00c-a5adc86f7d29 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.151924 Sep 01 00:34:18.753226 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 273/557] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:18 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:19.776097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:19.776742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:19.783099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:19.783584 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:19.784211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:19.784930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:19.785942 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:19.786371 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:19.918249 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:19.926207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-022bb9de-0ad9-4792-8a20-898cdc2c7158 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1364 microversion: 2.1 time: 0.154728 Sep 01 00:34:19.926770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 285/558] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:19 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:20.947043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:20.947589 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:20.954282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:20.954765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:20.955202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:20.955894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:20.956347 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:20.957383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.098550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:21.106295 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5aafa5db-60df-42a5-9f35-d79b4504afbf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1550 microversion: 2.1 time: 0.163180 Sep 01 00:34:21.106919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 274/559] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:20 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1550 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:21.126054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:21.126633 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:21.133735 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:21.134214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:21.134645 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.135329 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:21.135774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:21.136194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.207523 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:21.207928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:21.213924 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:21.214405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:21.214817 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d7cfae72-201c-45a2-9f7f-acc35bda71ed tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092571 Sep 01 00:34:21.214932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.215406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 286/560] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:34:21 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:21.215551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:21.215938 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:21.216353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.298036 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'services' on Instance uuid abf8d128-7684-4263-babf-222cc0beae80 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:21.374009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f4ea8dcd-47a3-42d3-95ef-4aea02492508 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments/f68e1fd8-d399-48e1-9d9e-45048db32359" status: 202 len: 0 microversion: 2.1 time: 0.170328 Sep 01 00:34:21.379124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 275/561] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:34:21 2022] DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments/f68e1fd8-d399-48e1-9d9e-45048db32359 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 00:34:21.385424 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:21.388388 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:21.395099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:21.395659 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:21.396136 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.396881 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:21.397342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:21.397768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:21.431615 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-410e7b4c-ec6a-41f2-add4-9f3298b6c4b7 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050593 Sep 01 00:34:21.432612 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 287/562] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:34:21 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:22.423041 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-05ea674b-cfd6-4ccd-abfe-5ef50a9776df req-2c28fce9-51c8-4156-8d52-6e67fac51233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afcd12a5-5d5a-4b6e-868e-06353c107d8d", "tag": "6e1784d4-2cf5-4a72-8d15-fe2c896999f1"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:22.433006 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-05ea674b-cfd6-4ccd-abfe-5ef50a9776df req-2c28fce9-51c8-4156-8d52-6e67fac51233 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.433480 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-05ea674b-cfd6-4ccd-abfe-5ef50a9776df req-2c28fce9-51c8-4156-8d52-6e67fac51233 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.433904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-05ea674b-cfd6-4ccd-abfe-5ef50a9776df req-2c28fce9-51c8-4156-8d52-6e67fac51233 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.445263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:22.446864 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-05ea674b-cfd6-4ccd-abfe-5ef50a9776df req-2c28fce9-51c8-4156-8d52-6e67fac51233 service nova] Creating event network-changed:6e1784d4-2cf5-4a72-8d15-fe2c896999f1 for instance afcd12a5-5d5a-4b6e-868e-06353c107d8d on hv-cinder-82002 Sep 01 00:34:22.447757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:22.452082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-05ea674b-cfd6-4ccd-abfe-5ef50a9776df req-2c28fce9-51c8-4156-8d52-6e67fac51233 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033478 Sep 01 00:34:22.453204 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 276/563] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:22.455028 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.456093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.456568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.458100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.458561 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.458994 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.490542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8de36599-8815-4b3c-9fe3-7a6a83a86407 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050031 Sep 01 00:34:22.491127 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 288/564] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:34:22 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:34:22.572568 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:22.573459 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:22.581144 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.581675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.582861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.583786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.584667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.584786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.610472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:34:22.696479 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6498fd2b-f345-4e1b-90ef-8988f2befc2a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 204 len: 0 microversion: 2.1 time: 0.127453 Sep 01 00:34:22.700545 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 277/565] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:34:22 2022] DELETE /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:34:22.709171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:22.710019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:22.716260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.716963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.717549 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.718594 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:22.719431 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:22.720013 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:22.865997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:22.873652 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-04822db7-2fa6-4a73-bf47-d3d9a13ef637 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1687 microversion: 2.1 time: 0.171376 Sep 01 00:34:22.874218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 289/566] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:22 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1687 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:23.896325 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:23.897209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:23.903562 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:23.904040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:23.904472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:23.905187 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:23.905637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:23.906059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:24.036950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:24.044890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7bf6a0ed-457a-4a4e-92f0-525537344284 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1687 microversion: 2.1 time: 0.153482 Sep 01 00:34:24.045465 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 278/567] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:23 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1687 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:25.065528 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:25.066202 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:25.072760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:25.073241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:25.073675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:25.074357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:25.074801 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:25.075219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:25.203288 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:25.211591 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-01e673eb-7ccb-44a5-ba36-ec0707b41276 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1687 microversion: 2.1 time: 0.149815 Sep 01 00:34:25.212163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 290/568] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:25 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:26.208831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:26.209421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:26.215729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:26.216213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:26.216684 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:26.217370 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:26.217816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:26.218236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:26.232838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:26.233700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:26.237416 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:26.240772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:26.241264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:26.241700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:26.242075 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lazy-loading 'flavor' on Instance uuid 12865e9d-801f-4fc9-a160-3628da11fe30 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:26.242410 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:26.242858 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:26.243282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:26.323906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8e5f1960-c0b7-4b42-ac08-6568c10c7607 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "POST /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.119488 Sep 01 00:34:26.324685 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 279/569] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:34:26 2022] POST /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:34:26.333895 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:26.334569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:26.340657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:26.341134 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:26.341562 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:26.342247 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:26.342691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:26.343101 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:26.459941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:26.471326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c4a732a4-1920-44bb-8081-9114da4d72eb tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1687 microversion: 2.1 time: 0.242202 Sep 01 00:34:26.478247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 291/570] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:26 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1687 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:34:26.489359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:26.498718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d4c7314b-e326-4fb0-adbf-268871d4a10e tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.169103 Sep 01 00:34:26.499511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 280/571] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:26 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:34:27.482114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-ba27035a-2895-425e-b670-17005123682e req-d44fc61c-3222-4b4e-8f74-fd6d28dd5246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abf8d128-7684-4263-babf-222cc0beae80", "name": "network-vif-deleted", "tag": "54ed4609-29d2-46df-968c-532a898d8333"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:27.493525 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:27.494097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-ba27035a-2895-425e-b670-17005123682e req-d44fc61c-3222-4b4e-8f74-fd6d28dd5246 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:27.494097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-ba27035a-2895-425e-b670-17005123682e req-d44fc61c-3222-4b4e-8f74-fd6d28dd5246 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:27.494264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:27.494520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-ba27035a-2895-425e-b670-17005123682e req-d44fc61c-3222-4b4e-8f74-fd6d28dd5246 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:27.501723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:27.506413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:27.507176 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-ba27035a-2895-425e-b670-17005123682e req-d44fc61c-3222-4b4e-8f74-fd6d28dd5246 service nova] Creating event network-vif-deleted:54ed4609-29d2-46df-968c-532a898d8333 for instance abf8d128-7684-4263-babf-222cc0beae80 on hv-cinder-82002 Sep 01 00:34:27.508021 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:27.512333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-ba27035a-2895-425e-b670-17005123682e req-d44fc61c-3222-4b4e-8f74-fd6d28dd5246 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034214 Sep 01 00:34:27.513018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 292/572] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:27.523249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:27.525045 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:27.525200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:27.526112 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:27.526233 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:27.533830 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:27.535556 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:27.536836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:27.537861 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:27.538582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:27.539235 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:27.654443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:27.665462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d16849a0-675e-4f9e-8f5b-1d9700b37a66 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 200 len: 1329 microversion: 2.1 time: 0.175860 Sep 01 00:34:27.678799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 281/573] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:27 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 1329 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:27.745542 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:27.753968 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6c7ab88b-8b3f-404e-8ba7-90040e092a91 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.234634 Sep 01 00:34:27.767383 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 293/574] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:27 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:28.686269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:28.686889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: abf8d128-7684-4263-babf-222cc0beae80] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:28.694416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:28.694912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:28.695354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:28.696071 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:28.696605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:28.697036 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:28.712186 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] HTTP exception thrown: Instance abf8d128-7684-4263-babf-222cc0beae80 could not be found. Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Request method failure captured: Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 HTTP/1.1 Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0GhEyvJ_PVtDwlrtoFX0jra6o3AW0UK3jQtMkVWq0CQXyAidUcnuMIcctNMm9_7xLitd3wLW3t31O_nGWArVIZv0ClA0s2dpWM-MpuwTu0duQUFEWKQXRR0_gXq-7E3X9iUoPQdHus1afQFGu2xNIheKMlEcOaFv5lHPugiRYNqkA Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:34:28.713894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}] Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: a6f08eaef2d149a9b0236d4bcbe03a92 Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance abf8d128-7684-4263-babf-222cc0beae80 could not be found. Sep 01 00:34:28.715460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'abf8d128-7684-4263-babf-222cc0beae80'} Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abf8d128-7684-4263-babf-222cc0beae80 could not be found. Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:34:28.716344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abf8d128-7684-4263-babf-222cc0beae80 could not be found. Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abf8d128-7684-4263-babf-222cc0beae80 could not be found. Sep 01 00:34:28.717859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:28.719350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Returning 404 to user: Instance abf8d128-7684-4263-babf-222cc0beae80 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:34:28.719350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-17f2c39c-af94-40e1-9f40-3705a26b5e5a tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80" status: 404 len: 111 microversion: 2.1 time: 0.033180 Sep 01 00:34:28.719350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 282/575] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:28 2022] GET /compute/v2.1/servers/abf8d128-7684-4263-babf-222cc0beae80 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:34:28.724809 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-27c30405-c042-4853-9ac7-4aff78ab9581 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '.version_select at 0x7fcadff461f0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:28.744489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-27c30405-c042-4853-9ac7-4aff78ab9581 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646029963" status: 202 len: 0 microversion: 2.1 time: 0.023695 Sep 01 00:34:28.745093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 294/576] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 00:34:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646029963 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:34:28.775495 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:28.776062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:28.785653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:28.786147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:28.786618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:28.787308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:28.787769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:28.788192 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:28.941619 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:28.949742 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4dc01108-e9a5-42f7-a883-d8bc9f9ab827 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.178965 Sep 01 00:34:28.950305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 283/577] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:28 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:29.971254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:29.971796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:29.979404 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:29.979884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:29.980315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:29.981026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:29.981479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:29.981898 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:30.111065 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:30.119632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-919ce7f1-6146-4425-8a77-5159f537d97d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.152395 Sep 01 00:34:30.120196 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 295/578] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:29 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:31.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:31.142811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:31.149691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:31.150174 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:31.150611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:31.151303 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:31.151752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:31.152175 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:31.154824 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:31.285577 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:31.294318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ffdad965-e3ee-4776-ae0d-55cf6dee43ae tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.155867 Sep 01 00:34:31.294884 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 284/579] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:31 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:31.611594 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:31.612092 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:31.619660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:31.620138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:31.620598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:31.621283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:31.621729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:31.622156 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:31.647219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:34:31.727109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7e844b2d-ae42-4c2e-9718-fe0bb512bfad tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 204 len: 0 microversion: 2.1 time: 0.119380 Sep 01 00:34:31.727692 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 296/580] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:34:31 2022] DELETE /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:34:31.735885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:31.736484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:31.742986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:31.743468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:31.743898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:31.744613 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:31.745061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:31.745479 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:31.881348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:31.888970 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-26d07f67-2df6-4a11-bf69-3990e28eb731 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1507 microversion: 2.1 time: 0.156898 Sep 01 00:34:31.889528 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 285/581] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:31 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:32.318049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:32.318742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:32.324680 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:32.325162 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:32.325595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:32.326277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:32.326721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:32.327140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:32.456407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:32.464080 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-67e55fab-8d48-4799-9fbf-d6fe58348ed1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.151022 Sep 01 00:34:32.464660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 297/582] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:32 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:32.911414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:32.912025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:32.918517 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:32.918996 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:32.919436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:32.920128 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:32.920613 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:32.921043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:33.048757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:33.056446 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a4eb5fd0-614b-4425-8efc-0f44acd45d0f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1507 microversion: 2.1 time: 0.149085 Sep 01 00:34:33.057030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 286/583] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:32 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:33.485806 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:33.486362 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:33.493421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:33.493898 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:33.494610 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:33.495293 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:33.495741 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:33.496159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:33.628836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:33.636516 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3dc49353-1f37-460b-9c16-cf86795e63db tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.154643 Sep 01 00:34:33.637123 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 298/584] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:33 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:34.077721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:34.078330 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:34.085509 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:34.085992 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:34.086425 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:34.087114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:34.087567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:34.087994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:34.219233 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:34.228245 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-37563b8a-ad8e-42fb-ad3b-a09e159ba4c0 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1507 microversion: 2.1 time: 0.154640 Sep 01 00:34:34.228891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 287/585] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:34 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:34.657510 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:34.658117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:34.664474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:34.664984 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:34.665419 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:34.666109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:34.666555 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:34.666970 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:34.837053 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-9654905c-7704-4d9d-aaa9-518f0340591b req-37d01c71-8a0b-40dc-8b65-ba537e2d48f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7927467f-419a-4f70-a627-f848aac91723", "name": "network-vif-deleted", "tag": "e3a2ca38-adcd-48ab-b08c-8dd6c075e6ed"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:34.847079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9654905c-7704-4d9d-aaa9-518f0340591b req-37d01c71-8a0b-40dc-8b65-ba537e2d48f6 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:34.847900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9654905c-7704-4d9d-aaa9-518f0340591b req-37d01c71-8a0b-40dc-8b65-ba537e2d48f6 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:34.848638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9654905c-7704-4d9d-aaa9-518f0340591b req-37d01c71-8a0b-40dc-8b65-ba537e2d48f6 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:34.863549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-9654905c-7704-4d9d-aaa9-518f0340591b req-37d01c71-8a0b-40dc-8b65-ba537e2d48f6 service nova] Creating event network-vif-deleted:e3a2ca38-adcd-48ab-b08c-8dd6c075e6ed for instance 7927467f-419a-4f70-a627-f848aac91723 on hv-cinder-82002 Sep 01 00:34:34.870457 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:34.877046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-9654905c-7704-4d9d-aaa9-518f0340591b req-37d01c71-8a0b-40dc-8b65-ba537e2d48f6 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043587 Sep 01 00:34:34.877856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 288/586] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:34.880474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-90bb124e-df81-418c-a6c7-40f85b1d1bdb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.226524 Sep 01 00:34:34.886250 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 299/587] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:34 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:35.251739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:35.252436 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:35.258784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:35.259266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:35.259702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:35.260400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:35.260880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:35.261302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:35.291947 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:35.292424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:35.292891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:35.293332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'fault' on Instance uuid 7927467f-419a-4f70-a627-f848aac91723 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:35.334923 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:35.342414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1cf8af1e-d987-48e1-bb5e-965bd0a43945 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 200 len: 1312 microversion: 2.1 time: 0.095319 Sep 01 00:34:35.342979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 289/588] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:35 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:35.901184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:35.901794 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:35.908126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:35.908648 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:35.909724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:35.910420 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:35.910877 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:35.911302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:35.926788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:36.043888 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:36.052067 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-dadfc314-72c7-4ca2-843a-b5bcdb3a7ab5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.154702 Sep 01 00:34:36.052656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 300/589] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:35 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:36.363441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:36.363985 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: 7927467f-419a-4f70-a627-f848aac91723] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:36.370622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:36.371105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:36.371544 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:36.372234 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:36.372716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:36.373143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:36.386849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] HTTP exception thrown: Instance 7927467f-419a-4f70-a627-f848aac91723 could not be found. Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Request method failure captured: Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 HTTP/1.1 Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0GhEyvJ_PVtDwlrtoFX0jra6o3AW0UK3jQtMkVWq0CQXyAidUcnuMIcctNMm9_7xLitd3wLW3t31O_nGWArVIZv0ClA0s2dpWM-MpuwTu0duQUFEWKQXRR0_gXq-7E3X9iUoPQdHus1afQFGu2xNIheKMlEcOaFv5lHPugiRYNqkA Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:34:36.388484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}] Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: a6f08eaef2d149a9b0236d4bcbe03a92 Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 7927467f-419a-4f70-a627-f848aac91723 could not be found. Sep 01 00:34:36.390082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '7927467f-419a-4f70-a627-f848aac91723'} Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7927467f-419a-4f70-a627-f848aac91723 could not be found. Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:34:36.390962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7927467f-419a-4f70-a627-f848aac91723 could not be found. Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7927467f-419a-4f70-a627-f848aac91723 could not be found. Sep 01 00:34:36.392288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:36.394366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Returning 404 to user: Instance 7927467f-419a-4f70-a627-f848aac91723 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:34:36.394366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-33de66b2-42fd-43ea-b9dd-2b7b16af846d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723" status: 404 len: 111 microversion: 2.1 time: 0.030916 Sep 01 00:34:36.394366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 290/590] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:36 2022] GET /compute/v2.1/servers/7927467f-419a-4f70-a627-f848aac91723 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:34:36.398924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:36.399417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:36.405333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:36.405789 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:36.406218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:36.406896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:36.407341 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:36.407759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:36.432588 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:34:36.506030 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a3b70a2d-1402-43c5-bd6f-771d26f4b77f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "DELETE /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 204 len: 0 microversion: 2.1 time: 0.110542 Sep 01 00:34:36.506634 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 301/591] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:34:36 2022] DELETE /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:34:36.516354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:36.517007 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:36.524028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:36.524472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:36.524943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:36.525641 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:36.526086 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:36.526507 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:36.655886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:36.663641 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-85f7e010-6838-467a-81d8-8e5d5680b9bc tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.151627 Sep 01 00:34:36.664196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 291/592] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:36 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:37.072895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:37.073620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:37.080313 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:37.080829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:37.081871 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:37.082568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:37.083020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:37.083444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:37.219516 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:37.228068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ee2f933a-b43f-4abe-991b-5ebde1cda258 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.159325 Sep 01 00:34:37.228867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 302/593] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:37 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:37.684707 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:37.685327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:37.691579 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:37.692334 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:37.692928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:37.693616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:37.694136 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:37.694559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:37.825943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:37.834388 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7fb507f6-fd4b-4fd8-ac60-f6a95fcb016f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.153574 Sep 01 00:34:37.834953 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 292/594] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:37 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:38.249363 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:38.249978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:38.256837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:38.257335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:38.257778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:38.258483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:38.258975 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:38.259403 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:38.388461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:38.396690 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3c3d4a84-12fc-4d8c-ae88-7d0b7fd69bdc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.151278 Sep 01 00:34:38.397263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 303/595] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:38 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:38.854438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:38.855045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:38.861959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:38.862622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:38.863066 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:38.863787 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:38.864518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:38.864977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:38.991200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:38.998712 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b3af3b35-e3d8-4eb5-8cdd-32af765b331f tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.148164 Sep 01 00:34:38.999271 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 293/596] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:38 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:39.417497 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:39.418109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:39.424555 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:39.425116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:39.425668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:39.426911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:39.427356 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:39.427779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:39.560315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:39.569142 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a41b44d0-8034-4ad4-b12b-8c288c2b64e5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.155524 Sep 01 00:34:39.569701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 304/597] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:39 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:40.019130 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:40.019740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:40.023387 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:40.028738 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:40.029235 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:40.029718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:40.030409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:40.030859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:40.031279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:40.168083 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:40.175798 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a6bc1c33-685b-4ed0-af80-b86926d52c09 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1521 microversion: 2.1 time: 0.160560 Sep 01 00:34:40.176362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 294/598] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:40 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:40.590949 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:40.591626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:40.598957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:40.599451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:40.600030 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:40.600757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:40.601292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:40.601739 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:40.717416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-aa7eb054-ac3e-4805-8370-f08bb5541261 req-d62f8bdd-521d-43f4-bf4c-f1bd4b0a60c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5dc5608-df5a-4c41-9d46-fd161e18e075", "name": "network-vif-deleted", "tag": "1686bbb5-7c47-498b-bb89-88826527d80e"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:40.728047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-aa7eb054-ac3e-4805-8370-f08bb5541261 req-d62f8bdd-521d-43f4-bf4c-f1bd4b0a60c8 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:40.728708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-aa7eb054-ac3e-4805-8370-f08bb5541261 req-d62f8bdd-521d-43f4-bf4c-f1bd4b0a60c8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:40.729141 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-aa7eb054-ac3e-4805-8370-f08bb5541261 req-d62f8bdd-521d-43f4-bf4c-f1bd4b0a60c8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:40.743129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-aa7eb054-ac3e-4805-8370-f08bb5541261 req-d62f8bdd-521d-43f4-bf4c-f1bd4b0a60c8 service nova] Creating event network-vif-deleted:1686bbb5-7c47-498b-bb89-88826527d80e for instance f5dc5608-df5a-4c41-9d46-fd161e18e075 on hv-cinder-82002 Sep 01 00:34:40.748253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-aa7eb054-ac3e-4805-8370-f08bb5541261 req-d62f8bdd-521d-43f4-bf4c-f1bd4b0a60c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034329 Sep 01 00:34:40.748964 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 295/599] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:40.823843 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:40.833669 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4f02ebbc-eb23-486b-903f-6bff8d8674e0 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.246491 Sep 01 00:34:40.834250 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 305/600] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:40 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:41.198230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:41.198917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:41.205254 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:41.205735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:41.206169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:41.206856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:41.207303 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:41.208392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:41.238601 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:41.239076 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:41.239507 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:41.239948 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'fault' on Instance uuid f5dc5608-df5a-4c41-9d46-fd161e18e075 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:41.284669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:41.292630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-57816429-c8bb-4d1d-9771-f972073a998d tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1312 microversion: 2.1 time: 0.099082 Sep 01 00:34:41.293284 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 296/601] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:41 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1312 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:41.855216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:41.855757 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:41.862601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:41.863081 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:41.863515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:41.864880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:41.865337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:41.865760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:41.998639 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:42.007405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ddb9c983-e49d-4db1-a34a-41dd3fdcb443 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.156116 Sep 01 00:34:42.007978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 306/602] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:41 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:42.313501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:42.314111 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:42.320057 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:42.320570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:42.321146 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:42.321840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:42.322290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:42.322717 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:42.354441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:42.354921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:42.355358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:42.355804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lazy-loading 'fault' on Instance uuid f5dc5608-df5a-4c41-9d46-fd161e18e075 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:42.395396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6f08eaef2d149a9b0236d4bcbe03a92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64e86923fd7b42cfaf18408210d4f6d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:42.402993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-398d9ae4-c796-4737-8e77-d9db67e79bd4 tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 200 len: 1312 microversion: 2.1 time: 0.093424 Sep 01 00:34:42.403557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 297/603] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:42 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:43.029590 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:43.030206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:43.037309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:43.037793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:43.038221 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:43.038918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:43.039537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:43.040011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:43.182623 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:43.191880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-af28bc2a-1beb-4b2f-a2f1-f0af7afc6cc7 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.165837 Sep 01 00:34:43.192692 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 307/604] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:43 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:43.424070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:43.424721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] [instance: f5dc5608-df5a-4c41-9d46-fd161e18e075] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:43.431642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:43.432125 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:43.432591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:43.433290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:43.433743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:43.434170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:43.447442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] HTTP exception thrown: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 could not be found. Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Request method failure captured: Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 HTTP/1.1 Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0GhEyvJ_PVtDwlrtoFX0jra6o3AW0UK3jQtMkVWq0CQXyAidUcnuMIcctNMm9_7xLitd3wLW3t31O_nGWArVIZv0ClA0s2dpWM-MpuwTu0duQUFEWKQXRR0_gXq-7E3X9iUoPQdHus1afQFGu2xNIheKMlEcOaFv5lHPugiRYNqkA Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:34:43.449085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/64e86923fd7b42cfaf18408210d4f6d7"}]}] Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 64e86923fd7b42cfaf18408210d4f6d7 Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293434156 Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: a6f08eaef2d149a9b0236d4bcbe03a92 Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293434156-project Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 could not be found. Sep 01 00:34:43.450633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'f5dc5608-df5a-4c41-9d46-fd161e18e075'} Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 could not be found. Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:34:43.451661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 could not be found. Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 could not be found. Sep 01 00:34:43.453396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:34:43.454761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] Returning 404 to user: Instance f5dc5608-df5a-4c41-9d46-fd161e18e075 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:34:43.454761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-48186a74-67bb-456c-9175-e995d7d033ed tempest-ServerRescueNegativeTestJSON-293434156 tempest-ServerRescueNegativeTestJSON-293434156-project] 10.222.0.25 "GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075" status: 404 len: 111 microversion: 2.1 time: 0.030179 Sep 01 00:34:43.454761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 298/605] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:43 2022] GET /compute/v2.1/servers/f5dc5608-df5a-4c41-9d46-fd161e18e075 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:34:44.112183 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:44.112775 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:44.119872 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.120368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.120893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.121606 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.122065 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.122520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.148411 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d55ea313-9a48-4f17-9609-0e19eafeb8b5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/ips" status: 200 len: 151 microversion: 2.20 time: 0.040289 Sep 01 00:34:44.149048 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 308/606] 10.222.0.25 () {60 vars in 1289 bytes} [Thu Sep 1 00:34:44 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:34:44.214057 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:44.214718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:44.221008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.221531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.222158 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.222896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.223635 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.224232 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.384309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:44.392739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-68745f18-f324-4cd0-8ba6-b45868041068 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1511 microversion: 2.1 time: 0.182632 Sep 01 00:34:44.393306 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 299/607] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:44 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1511 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:44.420113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:44.421041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:44.428248 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.428843 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.429444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.430286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.430938 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.431600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.487171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132496) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 00:34:44.559872 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ac97f332-1bf5-4572-822b-bd71e56123f5 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "POST /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30/action" status: 202 len: 0 microversion: 2.1 time: 0.144316 Sep 01 00:34:44.560702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 309/608] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:34:44 2022] POST /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:34:44.569528 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:44.571249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:44.577946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.578426 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.579058 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.580095 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:44.580733 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:44.581205 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:44.729259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:44.737788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-23e380b5-b6b9-4b16-ae28-a072553c0254 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1519 microversion: 2.1 time: 0.172943 Sep 01 00:34:44.738362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 300/609] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:44 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:45.760806 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:45.761420 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:45.768399 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:45.768931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:45.769367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:45.770288 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:45.770733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:45.771165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:46.001517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:46.012934 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3b040a73-4cc3-4c45-8f43-376ef46d0759 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1521 microversion: 2.1 time: 0.255861 Sep 01 00:34:46.014947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 310/610] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:45 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:46.070461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-619892c4-f6b9-4bf1-9e4e-ad4307f35b22 req-75e25ccd-11d8-42d6-82af-1f0dd268dbc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "name": "network-vif-unplugged", "status": "completed", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:46.092395 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-619892c4-f6b9-4bf1-9e4e-ad4307f35b22 req-75e25ccd-11d8-42d6-82af-1f0dd268dbc8 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:46.092910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-619892c4-f6b9-4bf1-9e4e-ad4307f35b22 req-75e25ccd-11d8-42d6-82af-1f0dd268dbc8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:46.093344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-619892c4-f6b9-4bf1-9e4e-ad4307f35b22 req-75e25ccd-11d8-42d6-82af-1f0dd268dbc8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:46.104827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.compute.server_external_events [req-619892c4-f6b9-4bf1-9e4e-ad4307f35b22 req-75e25ccd-11d8-42d6-82af-1f0dd268dbc8 service nova] Unable to find a host for instance 12865e9d-801f-4fc9-a160-3628da11fe30. Dropping event network-vif-unplugged {{(pid=132498) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 00:34:46.105702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-619892c4-f6b9-4bf1-9e4e-ad4307f35b22 req-75e25ccd-11d8-42d6-82af-1f0dd268dbc8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039709 Sep 01 00:34:46.106618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 301/611] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:34:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 00:34:46.155391 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:46.155927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:46.165825 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:46.166712 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:46.167236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:46.168531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:46.173541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:46.174425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:46.200597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lazy-loading 'flavor' on Instance uuid 7144cea0-9e9b-42cb-8aa2-7012ad723c39 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:34:46.414785 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c15e8d3f-3365-490d-a8d1-681e366b801f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/action" status: 202 len: 0 microversion: 2.20 time: 0.263327 Sep 01 00:34:46.415682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 311/612] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 00:34:46 2022] POST /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:34:46.423298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:46.424179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:46.430584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:46.431414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:46.432210 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:46.433050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:46.433573 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:46.434004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:46.633345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:46.641812 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:46.643553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:46.645040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ba2b86d9-3cbc-4b7f-b742-5939c927e2c3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.225523 Sep 01 00:34:46.645777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 302/613] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:46 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:47.040666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:47.041990 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:47.048956 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:47.049453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:47.050068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:47.051484 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:47.052117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:47.052729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:47.380885 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:47.383698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:47.391629 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f9028a1d-426c-4eb1-9d27-0d99f83f11cc tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.355595 Sep 01 00:34:47.392212 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 312/614] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:47 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:47.667170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:47.667956 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:47.675541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:47.676817 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:47.677318 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:47.678025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:47.678499 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:47.678910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:47.683171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:47.850834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:47.859729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:47.861330 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:47.862639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-beda7b41-e588-4283-b5be-52ed751cba93 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.199336 Sep 01 00:34:47.864531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 303/615] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:47 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:48.414493 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:48.415279 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:48.423964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:48.424447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:48.424904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:48.425596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:48.426184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:48.426600 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:48.564550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:48.573228 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-08ae764a-3425-4b79-aeab-1ab40e4b8cc4 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.163491 Sep 01 00:34:48.573785 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 313/616] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:48 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:48.886030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:48.886636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:48.893617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:48.894103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:48.894541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:48.895252 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:48.895692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:48.896113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:49.035855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:49.044258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:49.045735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:49.046884 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-43fe6ff6-0f6c-4804-a1df-a080f807c7f1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.164946 Sep 01 00:34:49.047608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 304/617] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:48 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:49.594309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:49.594930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:49.601442 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:49.602144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:49.602586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:49.603291 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:49.603745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:49.604174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:49.748191 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:49.755353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7aed1fe2-ebb6-428a-aba6-4acfebfbc538 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.164869 Sep 01 00:34:49.755918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 314/618] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:49 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:50.071780 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:50.072414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:50.079248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:50.079735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:50.080169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:50.080938 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:50.081390 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:50.081842 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:50.219862 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:50.228902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:50.230077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:50.231246 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8167ba48-13dd-44b4-ab45-27bc986ea4e4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.163490 Sep 01 00:34:50.231803 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 305/619] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:50 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:50.776779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:50.777394 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:50.783704 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:50.784429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:50.784901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:50.786400 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:50.787020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:50.787613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:50.922723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:50.930709 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-995433da-f9a2-4841-84cc-bf82cac0fb62 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.157511 Sep 01 00:34:50.931281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 315/620] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:50 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:51.255939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:51.256576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:51.263144 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:51.263628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:51.264071 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:51.264808 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:51.265262 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:51.265692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:51.404283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:51.412591 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:51.414042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:51.415198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-10981519-3c37-4ea7-8f45-5bbe66dc6a75 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.163856 Sep 01 00:34:51.415789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 306/621] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:51 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:51.956306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:51.957550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:51.964317 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:51.964879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:51.965375 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:51.966206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:51.966772 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:51.967205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:52.111478 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:52.119997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d0ceea80-ba49-4319-8135-9f70573fce8d tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.169997 Sep 01 00:34:52.120781 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 316/622] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:51 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:52.438411 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:52.439122 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:52.446120 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:52.446653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:52.447153 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:52.447970 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:52.448489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:52.449021 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:52.585260 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:52.594626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:52.596072 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:52.597272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-09a59a48-a264-4e18-8466-fd12db3fd663 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.162947 Sep 01 00:34:52.598484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 307/623] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:52 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:53.141985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:53.142604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:53.149699 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:53.150186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:53.150623 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:53.151319 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:53.151775 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:53.152207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:53.284147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:53.292532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-810d7b4e-2b9b-4e4b-bbc0-c4cf2801a754 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.154488 Sep 01 00:34:53.293196 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 317/624] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:53 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:53.620718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:53.621324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:53.627736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:53.628219 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:53.629326 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:53.630001 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:53.630450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:53.630904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:53.759053 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:53.767148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:53.768939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:53.770863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c5871a30-77b5-410b-b913-53e0a29650d4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.153929 Sep 01 00:34:53.771422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 308/625] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:53 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:54.314803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:54.315412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:54.322446 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:54.322991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:54.323460 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:54.324151 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:54.324626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:54.325046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:54.459481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:54.467240 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-69b07f92-9fbb-499f-a732-54761a963e10 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.156203 Sep 01 00:34:54.467812 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 318/626] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:54 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:54.794031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:54.794634 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:54.801092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:54.801570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:54.802003 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:54.802688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:54.803134 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:54.803555 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:54.935272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:54.943414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:54.944875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:54.946024 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-169ca6b2-6d2f-4985-8314-b27a21f7072f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.155884 Sep 01 00:34:54.946590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 309/627] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:54 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:55.488273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:55.488971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:55.495321 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:55.495805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:55.496246 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:55.496974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:55.497439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:55.497870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:55.629483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:55.637205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6847a065-da10-4cc1-a1e3-8ef6cd00b2ff tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.152897 Sep 01 00:34:55.637798 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 319/628] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:55 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:55.971685 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:55.972443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:55.980147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:55.980664 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:55.981101 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:55.981821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:55.982267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:55.982692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:56.116424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:56.124756 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:56.126508 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:56.127667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d90fd1c1-04c7-44da-8efe-d74772cdc3f6 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.161519 Sep 01 00:34:56.128233 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 310/629] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:55 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:56.658908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:56.659463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:56.661940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:34:56.667788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:56.668274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:56.668730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:56.669426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:56.669875 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:56.670297 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:56.805489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:56.813021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d08b13a1-9cd4-480e-8d6e-9281c786260a tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.157976 Sep 01 00:34:56.813588 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 320/630] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:56 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:57.150521 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:57.151132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:57.157552 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:57.158044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:57.158483 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:57.159174 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:57.160111 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:57.160607 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:57.291968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:57.300035 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:57.301566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:57.302725 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a3295b3a-fad7-42f1-b8ea-a1ae925dab64 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.156119 Sep 01 00:34:57.303297 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 311/631] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:57 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:57.803766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:57.804266 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:57.810601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:57.811082 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:57.811517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:57.812207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:57.812697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:57.813125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:57.835497 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:57.836121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:57.837311 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-81e92bc7-8601-4cf8-a3c7-e9ed4791ec11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/ips" status: 200 len: 150 microversion: 2.1 time: 0.037431 Sep 01 00:34:57.837895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 321/632] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:34:57 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:57.842214 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:57.842694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:57.843123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:57.844076 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:57.844552 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:57.844979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:57.980986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:57.991121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-438f9688-fb24-4a34-8e79-9d201f7c6540 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.160081 Sep 01 00:34:57.994392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 312/633] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:57 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:34:58.325554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:58.326193 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:58.332974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:58.333447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:58.333878 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:58.334560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:58.335005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:58.335423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:58.472061 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:58.480589 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:58.482008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:58.483185 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-13509d3f-2038-40bb-afec-d2bfbae761f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.161749 Sep 01 00:34:58.483737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 322/634] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:58 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:34:59.012829 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:59.013420 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:59.022716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:59.022716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:59.022716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:59.022716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:59.023080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:59.023179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:59.156943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:59.184270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f3ae9557-f13e-45df-aca1-865057ceff8c tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.175117 Sep 01 00:34:59.185070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 313/635] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:34:59 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:34:59.196019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c99430ce-8d9f-4466-ba12-3cca07162959"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:34:59.198519 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:59.208668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:59.208668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:59.208668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:59.208668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:59.208978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:59.209240 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:59.452273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-feb581dd-1ec6-476d-9b82-37d2b581d836 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260402 Sep 01 00:34:59.458113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 323/636] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:34:59 2022] POST /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:34:59.507275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:34:59.507896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:34:59.513966 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:59.514448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:59.514885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:59.515601 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:34:59.516051 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:34:59.516473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:34:59.647383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:59.655365 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:59.656814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:34:59.657964 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a198941c-8509-4d48-b9f8-b08ed4a0a45e tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.155313 Sep 01 00:34:59.658517 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 314/637] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:34:59 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:00.208048 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:00.208767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:00.215332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:00.215810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:00.216264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:00.216980 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:00.217428 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:00.217845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:00.347276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:00.355209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7a16eec5-d484-42d0-8ec5-2b644c4ae9f9 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.151799 Sep 01 00:35:00.355770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 324/638] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:00 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:00.681624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:00.682236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:00.688714 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:00.689196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:00.689635 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:00.690324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:00.690774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:00.691247 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:00.823442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:00.831686 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:00.833171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:00.834333 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-619f36d9-20c4-4619-8fb7-5902df2275be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.156615 Sep 01 00:35:00.834896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 315/639] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:00 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:01.376635 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:01.377254 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:01.384165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:01.384693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:01.385138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:01.385835 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:01.386290 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:01.386719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:01.520570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:01.528239 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7cfbfba8-a79b-4b88-bea2-671b7f9c4038 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.155475 Sep 01 00:35:01.528834 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 325/640] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:01 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:01.857578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:01.858185 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:01.865424 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:01.865904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:01.866339 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:01.867028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:01.867477 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:01.867898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:01.997640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:02.007090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:02.008746 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:02.010030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d47cb53d-ca94-49d1-8865-94d5eab286f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.156205 Sep 01 00:35:02.010597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 316/641] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:01 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:02.400196 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-857126d7-83a1-4c5f-a521-85f3373504cd req-620d74ad-a1cc-4aa7-9900-a58ec680e554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "name": "network-vif-plugged", "status": "completed", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:02.413157 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-857126d7-83a1-4c5f-a521-85f3373504cd req-620d74ad-a1cc-4aa7-9900-a58ec680e554 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:02.413854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-857126d7-83a1-4c5f-a521-85f3373504cd req-620d74ad-a1cc-4aa7-9900-a58ec680e554 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:02.414283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-857126d7-83a1-4c5f-a521-85f3373504cd req-620d74ad-a1cc-4aa7-9900-a58ec680e554 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:02.426959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-857126d7-83a1-4c5f-a521-85f3373504cd req-620d74ad-a1cc-4aa7-9900-a58ec680e554 service nova] Creating event network-vif-plugged:7e1bd795-ba93-4500-a63a-3a150fd97453 for instance 12865e9d-801f-4fc9-a160-3628da11fe30 on hv-cinder-82002 Sep 01 00:35:02.431977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-857126d7-83a1-4c5f-a521-85f3373504cd req-620d74ad-a1cc-4aa7-9900-a58ec680e554 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036411 Sep 01 00:35:02.432904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 326/642] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:02.549471 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:02.550082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:02.556144 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:02.556664 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:02.557170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:02.557862 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:02.558313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:02.558735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:02.751690 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:02.760160 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc6624a1-a723-43b2-85e1-6d288062a0ca tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.214575 Sep 01 00:35:02.760767 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 317/643] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:02 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:03.032374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:03.033020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:03.039256 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:03.039732 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:03.040173 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:03.040881 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:03.041330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:03.041750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:03.238746 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:03.246755 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:03.248213 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:03.249412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6f745366-e8a9-49f0-aaed-782323bbcad3 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.221359 Sep 01 00:35:03.249977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 327/644] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:03 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:03.781909 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:03.782534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:03.789816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:03.790296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:03.790731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:03.791423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:03.791869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:03.792292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:03.921765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:03.930151 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-adc6336b-96d7-442e-a6cf-6e104f064592 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1577 microversion: 2.1 time: 0.152029 Sep 01 00:35:03.930730 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 318/645] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:03 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:04.438158 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:04.438768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:04.445385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:04.445866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:04.446297 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:04.446987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:04.447425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:04.447847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:04.581092 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:04.589927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:04.591374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:04.592569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e7a48e81-e0bd-4e87-8858-a587aa9999ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.323802 Sep 01 00:35:04.593391 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 328/646] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:04 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:04.951057 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:04.951917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:04.958492 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:04.958959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:04.959383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:04.960062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:04.960518 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:04.960997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:05.089758 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:05.091900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=100 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:05.098959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cd20c6cb-9a8a-4693-8219-b7ccae7314a3 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1564 microversion: 2.1 time: 0.151724 Sep 01 00:35:05.099515 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 319/647] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:04 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:05.615259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:05.615875 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:05.622426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:05.622923 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:05.623345 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:05.624031 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:05.624481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:05.624929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:05.627550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:05.755554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:05.763558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:05.765024 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:05.766202 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6a616662-458a-4a39-acca-b2b36b6da6d1 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.154891 Sep 01 00:35:05.766787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 329/648] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:05 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:06.324961 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:06.325448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:06.332647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:06.333171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:06.333613 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:06.334336 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:06.334788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:06.335215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:06.358658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-be41b107-a20e-492e-b036-76bbd9a8eff8 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/ips" status: 200 len: 146 microversion: 2.1 time: 0.139935 Sep 01 00:35:06.359207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 320/649] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:35:06 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/ips => generated 146 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:06.789262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:06.789880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:06.796314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:06.796837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:06.797283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:06.798079 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:06.798539 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:06.798967 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:06.929750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:06.937598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:06.939020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:06.940162 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ad4290a5-f507-4aa9-8ad9-7802e082c5de tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.154814 Sep 01 00:35:06.940738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 330/650] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:06 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:07.962468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:07.963070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:07.969089 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:07.969570 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:07.970002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:07.970689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:07.971133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:07.971549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:08.105305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:08.114147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:08.115575 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:08.116761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cc4b8cd3-dd29-4cc9-9e17-abb396333b9a tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.157984 Sep 01 00:35:08.117320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 321/651] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:07 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:08.731625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8613d9e0-7ebe-4377-a38d-838175ca58f3"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:08.734118 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:08.741464 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:08.741953 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:08.742394 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:08.743086 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:08.743545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:08.743970 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.098002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bc53619d-07d9-4c31-a089-65a435fcaa0a tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369174 Sep 01 00:35:09.099156 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 331/652] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:35:08 2022] POST /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 194 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:09.138324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:09.139583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:09.145007 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c99430ce-8d9f-4466-ba12-3cca07162959"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:09.149018 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.149951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.150774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.152267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.152921 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:09.153597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.154162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.160367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.160979 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.161421 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.162127 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.162577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.163001 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.260924 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Invalid volume: volume c99430ce-8d9f-4466-ba12-3cca07162959 is already attached to instances: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: POST /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments HTTP/1.1 Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 74 Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:35:09.263273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {"volumeAttachment": {"volumeId": "c99430ce-8d9f-4466-ba12-3cca07162959"}} Sep 01 00:35:09.264985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Invalid volume: volume c99430ce-8d9f-4466-ba12-3cca07162959 is already attached to instances: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'server_id': 'ddd521ac-53c1-4789-94b2-c2fd1fa62bf5', 'body': {'volumeAttachment': {'volumeId': 'c99430ce-8d9f-4466-ba12-3cca07162959'}}} Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c99430ce-8d9f-4466-ba12-3cca07162959 is already attached to instances: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:09.266026 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c99430ce-8d9f-4466-ba12-3cca07162959 is already attached to instances: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:09.267397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c99430ce-8d9f-4466-ba12-3cca07162959 is already attached to instances: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 400 to user: Invalid volume: volume c99430ce-8d9f-4466-ba12-3cca07162959 is already attached to instances: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bb93904b-b559-49be-976d-1c8ae33bdf51 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.124465 Sep 01 00:35:09.269595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 332/653] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:35:09 2022] POST /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 174 bytes in 126 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 00:35:09.339143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:09.339754 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:09.340244 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:09.346121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.346597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.347082 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.348222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:09.348427 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.348729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.349144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.349739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:09.350892 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-52d6292f-ebf4-4d36-8396-cd5187b537a9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.216725 Sep 01 00:35:09.351445 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 322/654] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:09 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:09.429103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lazy-loading 'services' on Instance uuid ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:35:09.500018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-62a5eb67-05da-42ef-af4b-01d38829256f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments/c99430ce-8d9f-4466-ba12-3cca07162959" status: 202 len: 0 microversion: 2.1 time: 0.163958 Sep 01 00:35:09.500620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 333/655] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:35:09 2022] DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments/c99430ce-8d9f-4466-ba12-3cca07162959 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 00:35:09.510887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:09.513911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:09.520077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.520880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.521698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.522655 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:09.523253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:09.523870 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:09.558713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bfea7936-61c5-4cc0-83f9-671ca60bb04a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052610 Sep 01 00:35:09.559302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 323/656] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:09 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:10.380062 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:10.380062 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:10.383330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:10.383826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:10.384266 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:10.385007 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:10.385638 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:10.386656 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:10.524004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:10.532015 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:10.533479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:10.535144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5432a561-132f-47b7-be27-173464a85b33 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.163909 Sep 01 00:35:10.535698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 334/657] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:10 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:10.570972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:10.573236 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:10.575551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=64 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:10.581107 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:10.581680 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:10.582120 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:10.582865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:10.583312 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:10.583726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:10.613372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fa98e2bb-e91e-4683-a4e2-a3b483a9497a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045716 Sep 01 00:35:10.613935 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 324/658] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:10 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:11.557404 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:11.558015 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:11.564453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:11.564951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:11.565389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:11.566649 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:11.567096 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:11.567522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:11.625688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:11.627949 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:11.635196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:11.635679 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:11.636114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:11.636833 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:11.637283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:11.637706 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:11.667188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8235888d-80be-4a6e-b6a5-bb9f8bc23c58 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Sep 01 00:35:11.671031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 325/659] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:11 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:11.700931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:11.709227 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:11.710647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:11.711813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-84998c5f-dd7b-4e20-86bb-de6a77ce9547 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.158355 Sep 01 00:35:11.712349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 335/660] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:11 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:12.680174 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:12.682343 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:12.688615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:12.689108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:12.689547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:12.690270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:12.691275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:12.691706 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:12.723170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-84ccc31f-e8f0-41d8-90ef-68b1629add40 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047762 Sep 01 00:35:12.723732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 326/661] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:12 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:12.734089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:12.734700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:12.741264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:12.741752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:12.742242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:12.743098 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:12.743559 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:12.743983 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:12.879648 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:12.887670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:12.889155 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:12.890311 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c81e5328-52aa-47c4-9e26-d52daeec72ab tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.160085 Sep 01 00:35:12.890866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 336/662] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:12 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:13.734487 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:13.736660 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:13.743631 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:13.744050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:13.744480 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:13.745183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:13.745622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:13.746035 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:13.775346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-32638f96-4adb-450c-9b16-614ec88d06a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044806 Sep 01 00:35:13.775894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 327/663] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:13 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:13.913448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:13.914057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:13.920394 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:13.920906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:13.921340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:13.922021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:13.922467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:13.922886 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:14.053368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:14.061209 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:14.062627 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:14.063764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2a1bad18-aa50-41a6-960f-dd9af030a3c0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1743 microversion: 2.20 time: 0.154410 Sep 01 00:35:14.064321 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 337/664] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:13 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:14.788168 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:14.790473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:14.797025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:14.797498 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:14.798019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:14.798734 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:14.799301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:14.799722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:14.830258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-84adfaa5-0ce4-44ca-a47c-d637cca1abaf tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046726 Sep 01 00:35:14.831124 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 328/665] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:14 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:15.087197 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:15.087818 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:15.094252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:15.094726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:15.095157 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:15.095838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:15.096284 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:15.097282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:15.227515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:15.235572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:15.237092 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:15.238311 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c2912853-3658-4c9b-abcc-6869727c25e2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1743 microversion: 2.20 time: 0.155021 Sep 01 00:35:15.238864 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 338/666] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:15 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:15.845392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:15.848314 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:15.854804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:15.855417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:15.855850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:15.856651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:15.857105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:15.857529 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:15.889999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-707eb56a-2c5c-4db7-a5b6-6526aa4809d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Sep 01 00:35:15.890565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 329/667] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:15 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:16.261128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:16.261733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:16.268373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.269450 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.269885 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.270567 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.271014 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.271434 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.633138 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:16.635297 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:16.641272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.641755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.642193 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.642951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.643341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.644850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.646439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:16.654689 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:16.656147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:16.657350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-84df286a-4d69-4e8a-8d80-de711d9dcad4 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.400087 Sep 01 00:35:16.657895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 339/668] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:16 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:16.675264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d3c99329-6a2d-418b-b73f-f40d4b7e5054 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045450 Sep 01 00:35:16.675884 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 330/669] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:16 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:16.686122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:16.686614 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:16.693316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.693800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.694233 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.694951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.695401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.695822 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.723995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9ba490a2-fac7-4919-b7f2-d5378ff8c02f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/8613d9e0-7ebe-4377-a38d-838175ca58f3" status: 200 len: 194 microversion: 2.1 time: 0.041694 Sep 01 00:35:16.724575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 340/670] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 1 00:35:16 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/8613d9e0-7ebe-4377-a38d-838175ca58f3 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:16.902453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:16.904745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:16.911648 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.912164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.912666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.913360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:16.913811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:16.914231 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:16.954371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fe8e1d7d-24e2-4459-8c41-156b330d9866 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056324 Sep 01 00:35:16.959489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 331/671] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:16 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:17.681137 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:17.681749 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:17.687998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:17.688472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:17.688934 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:17.689613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:17.690060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:17.691126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:17.817787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:17.825597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:17.827289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:17.828426 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-701435a0-7d79-4227-ab31-9e044bd345b0 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.151227 Sep 01 00:35:17.828994 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 341/672] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:17 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:17.966986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:17.969138 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:17.976162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:17.976672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:17.977113 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:17.977807 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:17.978283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:17.978690 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:18.012653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-024636c4-f4a8-4759-8641-e4437b32ba7b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049378 Sep 01 00:35:18.017466 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 332/673] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:17 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:18.851379 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:18.851978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:18.858423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:18.858906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:18.859347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:18.860040 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:18.860522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:18.860942 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:18.992306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:19.000368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:19.001836 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:19.002995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-360837ec-489f-4c7c-800c-ca5cc7ae3260 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.155545 Sep 01 00:35:19.003541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 342/674] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:18 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:19.025275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:19.028876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:19.039167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:19.040168 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:19.040921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:19.041819 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:19.042460 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:19.043167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:19.082896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1fd6bb21-3e73-48d9-b6af-6a746cd55c23 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061485 Sep 01 00:35:19.083458 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 333/675] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:19 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:20.028536 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:20.029635 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:20.041107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.042257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.042982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.043977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.044922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.045586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.095007 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:20.097270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:20.130246 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.132847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.133416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.141280 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.142814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.144821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.237472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:20.246838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:20.253414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-bd91f2f4-67ea-484d-b816-8ea58644ebdb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.162222 Sep 01 00:35:20.256161 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:20.257475 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 334/676] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:20 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5/os-volume_attachments => generated 25 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 01 00:35:20.258214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:20.259570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-21815312-d957-45fa-a674-1f1c91adab47 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.237013 Sep 01 00:35:20.260111 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 343/677] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:20 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:20.268822 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2997c294-36b4-4523-94b7-7230ee36852d"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:20.271983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:20.278766 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.279695 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.280378 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.283241 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.283930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.284605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.355101 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:20.360194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:20.370663 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.371164 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.371603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.373009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.375257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.376252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.414165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:35:20.537635 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-7fda0c46-0484-4286-b6a6-00dee8a07f98 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 204 len: 0 microversion: 2.1 time: 0.192039 Sep 01 00:35:20.542760 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 344/678] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:35:20 2022] DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:35:20.557088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:20.557987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:20.565713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.566324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.567217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.567954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:20.568626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:20.568939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:20.633715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:20.656300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9931f7ee-609f-49ed-bf1f-a93b2a750748 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "POST /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.391371 Sep 01 00:35:20.657053 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 335/679] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:35:20 2022] POST /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 194 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:20.727702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:20.736275 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-875a868d-02a7-4554-b5df-9ec8811abae1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1682 microversion: 2.1 time: 0.190397 Sep 01 00:35:20.737116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 345/680] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:20 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1682 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:21.289198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:21.290900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:21.309248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:21.309929 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:21.310433 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:21.311352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:21.311866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:21.312369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:21.523189 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:21.534825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:21.537077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:21.538507 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-284012ef-25b7-4cc7-8687-a4c01f2a88e7 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.255571 Sep 01 00:35:21.556336 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 336/681] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:21 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:21.646580 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-dd0178b8-e7ae-4f03-94dd-1bb195ad0706 req-ed877a54-8d92-4162-a38b-26657f7ac2b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "name": "network-vif-plugged", "status": "completed", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:21.670108 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-dd0178b8-e7ae-4f03-94dd-1bb195ad0706 req-ed877a54-8d92-4162-a38b-26657f7ac2b7 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:21.670675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-dd0178b8-e7ae-4f03-94dd-1bb195ad0706 req-ed877a54-8d92-4162-a38b-26657f7ac2b7 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:21.671114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-dd0178b8-e7ae-4f03-94dd-1bb195ad0706 req-ed877a54-8d92-4162-a38b-26657f7ac2b7 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:21.684528 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-dd0178b8-e7ae-4f03-94dd-1bb195ad0706 req-ed877a54-8d92-4162-a38b-26657f7ac2b7 service nova] Creating event network-vif-plugged:6ad399c9-2cb1-4999-8111-29a8364f2345 for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 on hv-cinder-82002 Sep 01 00:35:21.690467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-dd0178b8-e7ae-4f03-94dd-1bb195ad0706 req-ed877a54-8d92-4162-a38b-26657f7ac2b7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049095 Sep 01 00:35:21.692078 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 346/682] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:21.759179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:21.759920 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:21.771235 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:21.771871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:21.775030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:21.776117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:21.777118 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:21.777804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:21.975740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:21.984295 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b2979384-476d-4fc5-9d1b-e8fc69064ee1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1682 microversion: 2.1 time: 0.228990 Sep 01 00:35:21.984909 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 337/683] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:21 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1682 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:22.563850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:22.564685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:22.574574 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:22.575422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:22.575972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:22.577682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:22.578544 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:22.579322 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:22.854733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:22.861240 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:22.862746 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:22.864162 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4f568a50-4e9a-416d-8351-16fb8e75a210 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.305555 Sep 01 00:35:22.864993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 347/684] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:22 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:23.008267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:23.009360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:23.017908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:23.018637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:23.020287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:23.021225 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:23.021827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:23.022399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:23.223152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:23.238994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-be0993b4-0e83-426a-b4a4-ca237dd1d648 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1682 microversion: 2.1 time: 0.235802 Sep 01 00:35:23.244560 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 338/685] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:23 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1682 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:23.767709 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-37f22122-86bd-44ee-934c-bd4605479a18 req-bb45f143-ab01-4041-8c03-fa475b7fc783 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ddd521ac-53c1-4789-94b2-c2fd1fa62bf5", "name": "network-vif-deleted", "tag": "485c34a1-1789-4ff4-a713-f780bd540db1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:23.795602 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-37f22122-86bd-44ee-934c-bd4605479a18 req-bb45f143-ab01-4041-8c03-fa475b7fc783 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:23.796184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-37f22122-86bd-44ee-934c-bd4605479a18 req-bb45f143-ab01-4041-8c03-fa475b7fc783 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:23.797128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-37f22122-86bd-44ee-934c-bd4605479a18 req-bb45f143-ab01-4041-8c03-fa475b7fc783 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:23.823701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-37f22122-86bd-44ee-934c-bd4605479a18 req-bb45f143-ab01-4041-8c03-fa475b7fc783 service nova] Creating event network-vif-deleted:485c34a1-1789-4ff4-a713-f780bd540db1 for instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 on hv-cinder-82002 Sep 01 00:35:23.837462 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-37f22122-86bd-44ee-934c-bd4605479a18 req-bb45f143-ab01-4041-8c03-fa475b7fc783 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190368 Sep 01 00:35:23.838616 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 348/686] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:23.890829 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:23.891915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:23.909716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:23.910256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:23.910697 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:23.911840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:23.912606 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:23.913186 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:24.128259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:24.143135 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:24.144972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:24.146723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6e36248c-609a-445e-8ad5-85dfbec72ffa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.261405 Sep 01 00:35:24.147907 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 339/687] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:23 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:24.272607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:24.273402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:24.282454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:24.282969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:24.283726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:24.286005 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:24.286896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:24.287607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:24.332968 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:24.333747 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:24.334191 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:24.334640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lazy-loading 'fault' on Instance uuid ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:35:24.403576 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:24.426479 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5489c8c7-4a2a-4a9e-9e54-d09e92a84752 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 200 len: 1331 microversion: 2.1 time: 0.159426 Sep 01 00:35:24.441351 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 349/688] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:24 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 1331 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:25.174035 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:25.174583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:25.194358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:25.194846 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:25.195286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:25.196012 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:25.196466 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:25.196914 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:25.447685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:25.449051 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:25.454201 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:25.465922 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:25.467876 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:25.469178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:25.469632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:25.471238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:25.472173 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:25.473874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:25.475576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a0127dab-9a09-45c6-980b-17bfa63301ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.308534 Sep 01 00:35:25.476327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:25.496736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 340/689] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:25 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:25.509436 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 HTTP/1.1 Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:35:25.511125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:35:25.512969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'ddd521ac-53c1-4789-94b2-c2fd1fa62bf5'} Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:25.513946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:35:25.515461 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:25.516953 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:25.516953 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a1c5024c-7db0-4dfc-975f-46972e5685fc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 404 len: 111 microversion: 2.1 time: 0.068662 Sep 01 00:35:25.522171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8497d0cb-8418-4bea-8ca6-95fc56f88b57 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '.version_select at 0x7fcadfe59af0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:25.526517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 350/690] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:25 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:25.543901 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8497d0cb-8418-4bea-8ca6-95fc56f88b57 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148936130" status: 202 len: 0 microversion: 2.1 time: 0.025911 Sep 01 00:35:25.558665 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 341/691] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 00:35:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1148936130 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:35:26.503745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:26.505133 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:26.521638 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:26.525328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:26.525806 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:26.529084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:26.531220 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:26.531714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:26.699739 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:26.723134 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:26.725233 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:26.726970 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cfce01da-43da-4051-ae83-343a1963718d tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.227746 Sep 01 00:35:26.732950 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 351/692] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:26 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:26.818274 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7617e61c-df7b-4c4f-8f39-2b9396a82337 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: .version_select at 0x7fcadfd3a790>, body: {"keypair": {"name": "tempest-keypair-2023529543", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBb52a4ToWOCUkTgZxbElMyVUkU9d5oG6DX12hVZnKXslqvkzS53+qqHPaA+hw1x9PV+kwpDZrfUJ2zv/64v0yStV7cynXJcUioGAruIV9IHLvPi7nb65hO83ii4ai+Rw=="}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:26.838268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-7617e61c-df7b-4c4f-8f39-2b9396a82337 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:35:26.844301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-7617e61c-df7b-4c4f-8f39-2b9396a82337 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'key_pairs'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:35:26.896886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7617e61c-df7b-4c4f-8f39-2b9396a82337 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.073618 Sep 01 00:35:26.896886 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 342/693] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:35:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:27.755941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:27.756582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:27.761099 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:27.784725 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:27.787838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:27.789665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:27.790621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:27.791441 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:27.794770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:28.005185 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:28.015784 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:28.017935 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:28.021047 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3965f2b8-ac73-44c1-b70e-76f6f97bb6b2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.270541 Sep 01 00:35:28.033763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 352/694] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:27 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:28.695731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2044695194", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c58401f2-7e87-4905-8554-61c4ec2b1ce1"}], "security_groups": [{"name": "tempest-securitygroup--1143899321"}], "key_name": "tempest-keypair-2023529543", "user_data": "}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:28.868117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] validate_networks() for [('c58401f2-7e87-4905-8554-61c4ec2b1ce1', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:35:29.051837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:29.054184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:29.065168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.066844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.067897 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.068857 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.069492 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.070077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.275718 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:29.285736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:29.288012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:29.289440 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9a595550-fa57-4c3a-b781-1f0b7e912c7f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.246409 Sep 01 00:35:29.290820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 353/695] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:29 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:29.524396 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:35:29.525114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:35:29.525716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:35:29.526668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:35:29.527141 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:35:29.537098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.537662 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.538176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.539071 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.539611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.540153 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.572356 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:35:29.577116 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Getting quotas for user e7a36e4630904f4eac08c9de1b8235ca and project b1bcb33a579e47518fafa960505447dc. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:35:29.591185 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:35:29.593675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:35:29.637375 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:29.640069 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:29.649545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.650327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.651053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.651843 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f8b38cde-97d7-490d-800a-d878cc75c635 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.962981 Sep 01 00:35:29.652186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.652844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 343/696] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:35:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:35:29.653227 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.653852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.665664 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f1c8c6b2-eae4-45ab-94c9-97843ba1cc5b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:29.666403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f1c8c6b2-eae4-45ab-94c9-97843ba1cc5b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:29.716844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c922b2fa-3087-43f8-844a-bc58770d12e7 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.092312 Sep 01 00:35:29.719327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 354/697] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:29 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 371 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:29.742332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f1c8c6b2-eae4-45ab-94c9-97843ba1cc5b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:29.750080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f1c8c6b2-eae4-45ab-94c9-97843ba1cc5b tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1242 microversion: 2.1 time: 0.088562 Sep 01 00:35:29.750968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 344/698] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:29 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:35:29.913386 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:29.914473 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:29.921947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.922724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.923603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.924995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.926174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.927171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.975492 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c1528b57-1a8a-46e4-a9df-2905abc0104d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/8613d9e0-7ebe-4377-a38d-838175ca58f3" status: 200 len: 194 microversion: 2.1 time: 0.068967 Sep 01 00:35:29.988100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:29.988954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:29.993847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 355/699] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 1 00:35:29 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/8613d9e0-7ebe-4377-a38d-838175ca58f3 => generated 194 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:29.997281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:29.998096 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:29.998779 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:29.999733 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:30.000434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:30.001148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:30.123654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lazy-loading 'services' on Instance uuid afcd12a5-5d5a-4b6e-868e-06353c107d8d {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:35:30.297987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-15863f51-b0f1-4a4c-94b1-d1b43e9b2ddb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/8613d9e0-7ebe-4377-a38d-838175ca58f3" status: 202 len: 0 microversion: 2.1 time: 0.311263 Sep 01 00:35:30.302033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 345/700] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:35:29 2022] DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/8613d9e0-7ebe-4377-a38d-838175ca58f3 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:35:30.314419 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:30.315543 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:30.324534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:30.325113 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:30.325470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:30.326450 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:30.326901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:30.327322 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:30.586966 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:30.600186 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:30.602517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:30.604518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6a53d932-cd42-47be-bc56-350f49cb3143 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.293653 Sep 01 00:35:30.608352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 356/701] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:30 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:30.773603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:30.775332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:30.783858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:30.784444 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:30.786095 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:30.786494 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:30.786994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:30.787618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:30.904210 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:30.914920 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7bd44502-d2c7-4c19-b991-ffe256aa32a3 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1246 microversion: 2.1 time: 0.146907 Sep 01 00:35:30.915611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 346/702] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:30 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1246 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:31.631484 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:31.632316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:31.641617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:31.642336 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:31.643134 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:31.643868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:31.644933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:31.645545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:31.800090 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:31.810033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:31.811454 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:31.812680 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-52a3074b-ef33-4253-8003-effc4add703f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1738 microversion: 2.20 time: 0.187857 Sep 01 00:35:31.813230 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 357/703] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:31 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:31.936552 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:31.937921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:31.945325 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:31.945903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:31.946409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:31.947177 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:31.947705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:31.948202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:32.021362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:32.029047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-266fe613-c10d-41a3-9b7b-e23f9f130152 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1294 microversion: 2.1 time: 0.096299 Sep 01 00:35:32.029583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 347/704] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:31 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:32.566800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:32.567483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:32.574420 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:32.575837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:32.576658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:32.577393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:32.578244 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:32.579469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:32.617739 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-035d38aa-c9fb-4279-b3a4-a8d5274b0103 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/2997c294-36b4-4523-94b7-7230ee36852d" status: 200 len: 194 microversion: 2.1 time: 0.054878 Sep 01 00:35:32.618537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 358/705] 10.222.0.25 () {58 vars in 1413 bytes} [Thu Sep 1 00:35:32 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/2997c294-36b4-4523-94b7-7230ee36852d => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:32.630045 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:32.631044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:32.637427 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:32.638184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:32.638976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:32.639772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:32.640448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:32.641002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:32.757835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lazy-loading 'services' on Instance uuid afcd12a5-5d5a-4b6e-868e-06353c107d8d {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:35:32.840384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:32.841236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:32.856169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:32.862590 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:32.864760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a3a18bbc-e4bb-41be-b881-2e23d1470535 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/2997c294-36b4-4523-94b7-7230ee36852d" status: 202 len: 0 microversion: 2.1 time: 0.238583 Sep 01 00:35:32.865532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:32.867461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 348/706] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:35:32 2022] DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments/2997c294-36b4-4523-94b7-7230ee36852d => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:35:32.868096 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:32.868988 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:32.869702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:33.051759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:33.052595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:33.059198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:33.059788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:33.060310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:33.061108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:33.061636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:33.062128 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:33.127821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:33.136668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0742d2e1-b017-4ceb-9313-0ef09ed6ec6c tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1300 microversion: 2.1 time: 0.089864 Sep 01 00:35:33.137303 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 349/707] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:33 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:35:33.148197 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:33.157555 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:33.159485 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:33.160718 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-deaf2e1b-8a0b-479e-856f-d6cc5faee4be tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1720 microversion: 2.20 time: 0.325668 Sep 01 00:35:33.161270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 359/708] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:32 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1720 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:34.064150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:34.066755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:34.073356 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.073859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.074289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.074999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.075454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.076134 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.097884 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-92371bd2-947b-492c-bdce-a819f377df89 req-1e59b477-cb47-4727-b1e2-d9ebbd7303b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6cf6ab-6209-485d-b0b0-07e534aff731", "tag": "e8f8c3e3-d46f-4e18-9620-44f218cd1524"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:34.108534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-443a4b72-d097-40b9-95d7-abfa6f5905f1 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047911 Sep 01 00:35:34.108764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-92371bd2-947b-492c-bdce-a819f377df89 req-1e59b477-cb47-4727-b1e2-d9ebbd7303b4 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.109077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 350/709] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:34 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:34.113315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-92371bd2-947b-492c-bdce-a819f377df89 req-1e59b477-cb47-4727-b1e2-d9ebbd7303b4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.113747 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-92371bd2-947b-492c-bdce-a819f377df89 req-1e59b477-cb47-4727-b1e2-d9ebbd7303b4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.124977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-92371bd2-947b-492c-bdce-a819f377df89 req-1e59b477-cb47-4727-b1e2-d9ebbd7303b4 service nova] Creating event network-changed:e8f8c3e3-d46f-4e18-9620-44f218cd1524 for instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 on hv-cinder-82002 Sep 01 00:35:34.129955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-92371bd2-947b-492c-bdce-a819f377df89 req-1e59b477-cb47-4727-b1e2-d9ebbd7303b4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036325 Sep 01 00:35:34.130533 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 360/710] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:34.159080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:34.160298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:34.166413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.166902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.167339 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.168032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.168485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.168961 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.185563 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:34.186049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:34.194136 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.194648 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.195081 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.195805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:34.196264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:34.201217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:34.205804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:34.360324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:34.368145 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4782cba7-2be9-4dd0-a803-48c486036da1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.212852 Sep 01 00:35:34.369096 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 351/711] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:34 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:34.387044 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:34.397702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:34.399124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:34.400329 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f3a2f7c5-6fb8-4eb8-a385-a60bd308a617 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1720 microversion: 2.20 time: 0.220417 Sep 01 00:35:34.400905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 361/712] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:34 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1720 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:35.120844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:35.123224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:35.131240 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.131825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.132325 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.133392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.133919 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.134400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.170769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-87cf4cbc-6fae-43cf-aa6d-83b1ed566a8e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053912 Sep 01 00:35:35.171592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 352/713] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:35 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:35:35.306777 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:35.309649 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:35.317227 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.317903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.318429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.319530 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.320217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.321019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.362747 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2ae274b7-e1ee-4a47-8518-6dd804a68a0e tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059790 Sep 01 00:35:35.370974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 362/714] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:35:35 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:35:35.391335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:35.392707 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:35.408393 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.424368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:35.426525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:35.432046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.433978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.434735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.437997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.438443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.440347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.454787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.457620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.458402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.462844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.463304 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.744678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:35.753618 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:35.755683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:35.756148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:35.757019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4993353c-f6af-4dc2-b284-e38b9cd4a7ec tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1723 microversion: 2.20 time: 0.337502 Sep 01 00:35:35.757582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 363/715] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:35 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1723 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:35.764386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e10d3dd9-5274-431b-8428-32ef7b1f22a2 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.378017 Sep 01 00:35:35.769458 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 353/716] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:35 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:35.775865 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:35.776875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:35.783615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.784292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.785472 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.787129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.787739 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.788376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.809415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:35.826290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:35:35.922724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-308a78a9-abf8-44eb-a5f5-5861815189db req-a2fdd997-3a7c-4c8f-b03b-6a08c2c9b4f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "name": "network-vif-unplugged", "status": "completed", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:35.947643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-64ef121a-e6b1-484e-b1c5-97d26a83f209 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 204 len: 0 microversion: 2.1 time: 0.176181 Sep 01 00:35:35.949127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 354/717] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:35:35 2022] DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:35:35.957414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92df4ba5-db29-4170-9efd-862d07671085"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:35.960665 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:35.968110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.968904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-308a78a9-abf8-44eb-a5f5-5861815189db req-a2fdd997-3a7c-4c8f-b03b-6a08c2c9b4f4 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.969351 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.970051 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.970222 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-308a78a9-abf8-44eb-a5f5-5861815189db req-a2fdd997-3a7c-4c8f-b03b-6a08c2c9b4f4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.970961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-308a78a9-abf8-44eb-a5f5-5861815189db req-a2fdd997-3a7c-4c8f-b03b-6a08c2c9b4f4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.971141 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:35.972912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:35.973755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:35.998285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.compute.server_external_events [req-308a78a9-abf8-44eb-a5f5-5861815189db req-a2fdd997-3a7c-4c8f-b03b-6a08c2c9b4f4 service nova] Unable to find a host for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39. Dropping event network-vif-unplugged {{(pid=132496) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Sep 01 00:35:35.999165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-308a78a9-abf8-44eb-a5f5-5861815189db req-a2fdd997-3a7c-4c8f-b03b-6a08c2c9b4f4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.240359 Sep 01 00:35:35.999751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 364/718] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 241 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 01 00:35:36.004692 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:36.005506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:36.011705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.012465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.012933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.013622 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.014231 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.014908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.186036 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:36.195961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9b498cf9-d4ec-4a21-8395-133a848d1ac2 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1675 microversion: 2.1 time: 0.194726 Sep 01 00:35:36.196897 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 365/719] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:35 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1675 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:36.346657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-09706f37-518f-47f2-8813-851f15336e4c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.395817 Sep 01 00:35:36.347692 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 355/720] 10.222.0.25 () {62 vars in 1364 bytes} [Thu Sep 1 00:35:35 2022] POST /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-volume_attachments => generated 188 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 01 00:35:36.480651 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:36.481139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:36.488346 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.488855 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.489294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.489995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.490447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.490874 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.729751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-39f921a1-24a1-4f7b-a392-0e448611a897 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-volume_attachments/92df4ba5-db29-4170-9efd-862d07671085" status: 202 len: 0 microversion: 2.20 time: 0.252980 Sep 01 00:35:36.730350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 366/721] 10.222.0.25 () {60 vars in 1457 bytes} [Thu Sep 1 00:35:36 2022] DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-volume_attachments/92df4ba5-db29-4170-9efd-862d07671085 => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:35:36.790727 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:36.791346 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:36.792270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:36.793046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:36.795081 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:36.797463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.797995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.798432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.799142 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.799579 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.800042 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.801298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.802467 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.802467 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.803290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.803749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.804398 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.837993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=132496) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Sep 01 00:35:36.912473 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-478c2a74-eeff-45af-ad06-8a526c91b5f8 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "POST /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/action" status: 202 len: 0 microversion: 2.20 time: 0.125607 Sep 01 00:35:36.913573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 367/722] 10.222.0.25 () {62 vars in 1319 bytes} [Thu Sep 1 00:35:36 2022] POST /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:35:36.930223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:36.930927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:36.937346 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.937946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.938474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:36.939269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:36.939813 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:36.940448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:37.036428 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:37.045353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4d3ad36a-f630-4b5e-b3c2-8ac9728e12cd tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.259467 Sep 01 00:35:37.046158 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 356/723] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:36 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:35:37.098550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:37.107858 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:37.109352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:37.111269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-14dbad03-27f5-4cba-986a-c87f735a34d2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1671 microversion: 2.20 time: 0.185037 Sep 01 00:35:37.114210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 368/724] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:36 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1671 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:37.218649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:37.219296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:37.227681 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:37.233618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:37.234132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:37.235004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:37.235536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:37.236432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:37.414230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:37.421979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3dafdace-325b-45c6-9696-be309beb6b70 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1675 microversion: 2.1 time: 0.207810 Sep 01 00:35:37.422550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 357/725] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:37 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:38.066889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:38.067506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:38.075376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:38.076126 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:38.076738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:38.077463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:38.077919 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:38.078557 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:38.136875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:38.137616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:38.143860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:38.144416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:38.145027 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:38.145718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:38.146161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:38.146579 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:38.218238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:38.226675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8ff2ee61-4413-4e68-8bcc-26a24b9a597d tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.163663 Sep 01 00:35:38.227230 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 369/726] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:38 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:35:38.278562 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:38.287056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:38.288512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:38.289640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2ce89705-2a33-4a03-9b2c-3a819d5acaae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1673 microversion: 2.20 time: 0.156798 Sep 01 00:35:38.290188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 358/727] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:38 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1673 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:38.444009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:38.444655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:38.450594 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:38.451350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:38.451783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:38.452465 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:38.452998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:38.453791 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:38.588471 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:38.596090 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-79271335-a281-4c2c-9e6e-217ffd5f78df tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1675 microversion: 2.1 time: 0.156513 Sep 01 00:35:38.596683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 370/728] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:38 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:39.250977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:39.252056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:39.260534 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:39.261793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:39.262386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:39.263267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:39.263835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:39.264480 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:39.313856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:39.314625 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:39.323091 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:39.323582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:39.324016 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:39.324750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:39.325202 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:39.325634 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:39.507439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:39.516178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-771e3607-3121-4ca8-8857-eba68559fe36 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.272284 Sep 01 00:35:39.517143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 359/729] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:39 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:39.618528 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:39.619126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:39.621188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:39.629128 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:39.629832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:39.630638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:39.632309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:39.634166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:39.634767 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:39.694156 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:39.708402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:39.710324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:39.712039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4ad3cbca-d766-45bc-9730-4f281b2db8ae tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.402182 Sep 01 00:35:39.713408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 371/730] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:39 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:39.752663 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=12 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:39.877764 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bf265cb4af14e2d8815c42288e2a1f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1064fc209674020b54fa7526cf22bf5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:39.886061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8be843b7-a70a-4ab1-b4d9-53d9ab6e193d tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 200 len: 1675 microversion: 2.1 time: 0.271735 Sep 01 00:35:39.896549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 360/731] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:39 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:35:40.067733 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-32f0540e-dcc1-4fab-905a-66d00b52ab05 req-1cb2371a-e2de-43b4-b935-ec05fc1771d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afcd12a5-5d5a-4b6e-868e-06353c107d8d", "name": "network-vif-deleted", "tag": "6e1784d4-2cf5-4a72-8d15-fe2c896999f1"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:40.093406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-32f0540e-dcc1-4fab-905a-66d00b52ab05 req-1cb2371a-e2de-43b4-b935-ec05fc1771d2 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.094451 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-32f0540e-dcc1-4fab-905a-66d00b52ab05 req-1cb2371a-e2de-43b4-b935-ec05fc1771d2 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.095488 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-32f0540e-dcc1-4fab-905a-66d00b52ab05 req-1cb2371a-e2de-43b4-b935-ec05fc1771d2 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.113750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-32f0540e-dcc1-4fab-905a-66d00b52ab05 req-1cb2371a-e2de-43b4-b935-ec05fc1771d2 service nova] Creating event network-vif-deleted:6e1784d4-2cf5-4a72-8d15-fe2c896999f1 for instance afcd12a5-5d5a-4b6e-868e-06353c107d8d on hv-cinder-82002 Sep 01 00:35:40.119553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-32f0540e-dcc1-4fab-905a-66d00b52ab05 req-1cb2371a-e2de-43b4-b935-ec05fc1771d2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059844 Sep 01 00:35:40.120844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 372/732] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:40.539806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:40.541531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:40.550823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.551597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.553294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.554251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.554930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.555569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.739385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:40.741243 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:40.750181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.751117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.751828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.754903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.755880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.756593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.774187 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:40.783012 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-47eeb3ca-5013-4750-b002-bf32fa369ff7 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.248860 Sep 01 00:35:40.797451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 361/733] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:40 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:40.909978 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:40.910887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:40.926473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.929136 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.929768 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.930494 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:40.933133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:40.933803 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:40.970435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] HTTP exception thrown: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Request method failure captured: Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d HTTP/1.1 Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0J-vJwsVD3eft6GqCWnwo7JtP5tTJmT_SAiipg32jw8Eor-eeW4-__i6UYppgOVuDYe_B1I2GV-vTypzKC444cvfJgh9RX6eS3T6_gBVvutRZK-gCFqAqb127LLNNSA7aUAoMY1v-lumzkbii_2aEoWfWQP0rAPiAIXhdcEFN8Acc Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:40.975851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}] Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 5bf265cb4af14e2d8815c42288e2a1f7 Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:40.977852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'afcd12a5-5d5a-4b6e-868e-06353c107d8d'} Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:40.978740 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:40.980248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:40.983367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Returning 404 to user: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:40.984698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-aab252e9-8594-4718-b94a-9da6744816fb tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 404 len: 111 microversion: 2.1 time: 0.079673 Sep 01 00:35:40.992116 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 362/734] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:40 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:41.001776 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:41.004044 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ac194fa3-85df-40ba-af59-bd56499ffabf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '.version_select at 0x7fcadfd3a4c0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:41.021774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:41.031596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:41.036326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-133003a1-e0a6-4d46-b09f-627f3f6b0962 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.300045 Sep 01 00:35:41.039595 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 373/735] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:40 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:41.055443 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ac194fa3-85df-40ba-af59-bd56499ffabf tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805661980" status: 202 len: 0 microversion: 2.1 time: 0.061265 Sep 01 00:35:41.055795 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 363/736] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 00:35:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1805661980 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:35:41.689700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-0a3b33f9-7d31-4952-90e5-be40a22043bf req-ebbaaa1a-64a3-4a7e-81ad-3a7c822b850c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6cf6ab-6209-485d-b0b0-07e534aff731", "name": "network-vif-plugged", "status": "completed", "tag": "e8f8c3e3-d46f-4e18-9620-44f218cd1524"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:41.707619 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-0a3b33f9-7d31-4952-90e5-be40a22043bf req-ebbaaa1a-64a3-4a7e-81ad-3a7c822b850c service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:41.709532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-0a3b33f9-7d31-4952-90e5-be40a22043bf req-ebbaaa1a-64a3-4a7e-81ad-3a7c822b850c service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:41.712287 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-0a3b33f9-7d31-4952-90e5-be40a22043bf req-ebbaaa1a-64a3-4a7e-81ad-3a7c822b850c service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:41.735559 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-0a3b33f9-7d31-4952-90e5-be40a22043bf req-ebbaaa1a-64a3-4a7e-81ad-3a7c822b850c service nova] Creating event network-vif-plugged:e8f8c3e3-d46f-4e18-9620-44f218cd1524 for instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 on hv-cinder-82002 Sep 01 00:35:41.760400 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-0a3b33f9-7d31-4952-90e5-be40a22043bf req-ebbaaa1a-64a3-4a7e-81ad-3a7c822b850c service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074705 Sep 01 00:35:41.768166 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 374/737] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:41.810103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:41.810713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:41.824351 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:41.835039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:41.835039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:41.835039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:41.835039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:41.835543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:42.070724 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:42.071560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:42.082521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:42.083700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:42.084210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:42.085151 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:42.085604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:42.086298 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:42.156037 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:42.177843 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0ab0681c-592d-4bf1-8ac1-94fb18026c08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.373374 Sep 01 00:35:42.182127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 364/738] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:41 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:42.353017 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:42.379894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:42.382024 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:42.383330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6cd48bab-611d-4f4f-b2e8-1eb4310cbbb2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.322905 Sep 01 00:35:42.383895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 375/739] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:42 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:43.202148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:43.202864 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:43.211943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:43.212438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:43.212927 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:43.213639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:43.214093 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:43.214711 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:43.361196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:43.369654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b0c19c2b-285a-46b7-ada6-b05c385be5d0 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.171559 Sep 01 00:35:43.370218 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 365/740] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:43 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:43.407933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:43.409168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:43.416832 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:43.417314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:43.417913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:43.418796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:43.419398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:43.419971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:43.424866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:43.625138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:43.634144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:43.637018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:43.644301 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-eafc536c-50ce-4a19-9950-07801d5ba93c tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.239132 Sep 01 00:35:43.656945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 376/741] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:43 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:44.391344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:44.391959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:44.401642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.401642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.401642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.402347 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.402805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.403392 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.546559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:44.555653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a6042c03-c62b-4687-b2d4-ffb3ef1787ce tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.168161 Sep 01 00:35:44.564549 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 366/742] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:44 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:44.670829 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:44.671543 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:44.680322 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.680906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.681346 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.682055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.682506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.682930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.799250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:44.800377 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:44.807654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.808537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.809250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.810453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.811097 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.811713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.827440 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] HTTP exception thrown: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Request method failure captured: Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d HTTP/1.1 Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0J-vJwsVD3eft6GqCWnwo7JtP5tTJmT_SAiipg32jw8Eor-eeW4-__i6UYppgOVuDYe_B1I2GV-vTypzKC444cvfJgh9RX6eS3T6_gBVvutRZK-gCFqAqb127LLNNSA7aUAoMY1v-lumzkbii_2aEoWfWQP0rAPiAIXhdcEFN8Acc Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:44.829586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}] Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 5bf265cb4af14e2d8815c42288e2a1f7 Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.830954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'afcd12a5-5d5a-4b6e-868e-06353c107d8d'} Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:44.831885 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.833123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.835326 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Returning 404 to user: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:44.837606 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2ebbc06a-3f98-4d8b-9d1d-b3676a813c28 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 404 len: 111 microversion: 2.1 time: 0.043028 Sep 01 00:35:44.841554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 367/743] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:35:44 2022] DELETE /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:44.847618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:44.848614 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: afcd12a5-5d5a-4b6e-868e-06353c107d8d] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:44.854860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.855861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.856732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.857805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:44.858452 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:44.859075 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:44.871225 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:44.880277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] HTTP exception thrown: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.881580 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Request method failure captured: Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d HTTP/1.1 Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0J-vJwsVD3eft6GqCWnwo7JtP5tTJmT_SAiipg32jw8Eor-eeW4-__i6UYppgOVuDYe_B1I2GV-vTypzKC444cvfJgh9RX6eS3T6_gBVvutRZK-gCFqAqb127LLNNSA7aUAoMY1v-lumzkbii_2aEoWfWQP0rAPiAIXhdcEFN8Acc Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:44.881867 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}] Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 5bf265cb4af14e2d8815c42288e2a1f7 Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.883432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'afcd12a5-5d5a-4b6e-868e-06353c107d8d'} Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:44.884294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. Sep 01 00:35:44.886115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:44.887350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Returning 404 to user: Instance afcd12a5-5d5a-4b6e-868e-06353c107d8d could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:44.887466 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:44.887565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1b137476-792b-4c07-a822-1d1f35f4151f tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d" status: 404 len: 111 microversion: 2.1 time: 0.040529 Sep 01 00:35:44.887565 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 368/744] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:44 2022] GET /compute/v2.1/servers/afcd12a5-5d5a-4b6e-868e-06353c107d8d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:35:44.887702 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-98145dac-3e85-448d-97ba-561e677e6600 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.217689 Sep 01 00:35:44.900438 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 377/745] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:44 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:45.578177 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:45.578774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:45.585684 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:45.586163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:45.586600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:45.587289 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:45.587741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:45.588167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:45.729555 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:45.732061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:45.739035 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5a1f9727-c56c-4a47-82ba-534dadc51eef tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.164947 Sep 01 00:35:45.739613 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 369/746] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:45 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:45.908612 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:45.909964 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:45.917577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:45.918070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:45.918509 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:45.919220 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:45.919675 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:45.920102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:46.064708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:46.066402 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:46.072694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:46.073727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:46.074238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:46.075016 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:46.075537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:46.076286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:46.076565 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:46.086737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:46.088180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:46.089388 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9f63a377-a88d-49f7-bfd8-4641974da755 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.185774 Sep 01 00:35:46.089947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 378/747] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:45 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:46.102530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] HTTP exception thrown: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Request method failure captured: Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 HTTP/1.1 Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0J-vJwsVD3eft6GqCWnwo7JtP5tTJmT_SAiipg32jw8Eor-eeW4-__i6UYppgOVuDYe_B1I2GV-vTypzKC444cvfJgh9RX6eS3T6_gBVvutRZK-gCFqAqb127LLNNSA7aUAoMY1v-lumzkbii_2aEoWfWQP0rAPiAIXhdcEFN8Acc Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:46.104200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}] Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 5bf265cb4af14e2d8815c42288e2a1f7 Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.105786 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '5f8ee3b6-8801-4650-8819-1587d9da7d98'} Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:46.106600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.107784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.108983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Returning 404 to user: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:46.108983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b03fc27f-baf9-430b-b44f-b72626e12c16 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 404 len: 111 microversion: 2.1 time: 0.045587 Sep 01 00:35:46.108983 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 370/748] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:35:46 2022] DELETE /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:46.115071 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:46.115687 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] [instance: 5f8ee3b6-8801-4650-8819-1587d9da7d98] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:46.121788 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:46.122276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:46.122845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:46.123552 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:46.124053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:46.124482 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:46.141128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] HTTP exception thrown: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Request method failure captured: Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 HTTP/1.1 Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0J-vJwsVD3eft6GqCWnwo7JtP5tTJmT_SAiipg32jw8Eor-eeW4-__i6UYppgOVuDYe_B1I2GV-vTypzKC444cvfJgh9RX6eS3T6_gBVvutRZK-gCFqAqb127LLNNSA7aUAoMY1v-lumzkbii_2aEoWfWQP0rAPiAIXhdcEFN8Acc Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:35:46.154367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/f1064fc209674020b54fa7526cf22bf5"}]}] Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: f1064fc209674020b54fa7526cf22bf5 Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeTestJSON-607076936 Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 5bf265cb4af14e2d8815c42288e2a1f7 Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeTestJSON-607076936-project Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.156009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '5f8ee3b6-8801-4650-8819-1587d9da7d98'} Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:46.156893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. Sep 01 00:35:46.158085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:46.159219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] Returning 404 to user: Instance 5f8ee3b6-8801-4650-8819-1587d9da7d98 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:46.159219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2d7b9a13-7b6c-45ad-9300-a2d882f5eb13 tempest-AttachVolumeTestJSON-607076936 tempest-AttachVolumeTestJSON-607076936-project] 10.222.0.25 "GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98" status: 404 len: 111 microversion: 2.1 time: 0.045523 Sep 01 00:35:46.159219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 379/749] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:46 2022] GET /compute/v2.1/servers/5f8ee3b6-8801-4650-8819-1587d9da7d98 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:35:46.760224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:46.761868 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:46.769938 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:46.770525 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:46.771647 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:46.773207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:46.773668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:46.774268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:47.111827 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:47.114039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:47.121518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:47.122446 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:47.123130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:47.124120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:47.124823 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:47.125527 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:47.322301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:47.330466 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:47.332423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c6ad12e7-e0a2-414a-9cf1-54be66da14cb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.576123 Sep 01 00:35:47.337339 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 371/750] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:46 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:47.352603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:47.354551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:47.356045 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2aca6eef-2c3e-49ce-87fd-838633fe204b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.248067 Sep 01 00:35:47.375767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 380/751] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:47 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:48.358166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:48.358866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:48.366587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:48.367484 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:48.368162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:48.369076 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:48.375871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:48.384155 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:48.386971 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:48.392137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:48.396002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:48.396506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:48.400213 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:48.400994 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:48.401617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:48.402206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:48.575394 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:48.586245 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:48.587992 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:48.589525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bc2cc249-054b-4a40-95b6-33f05ecbd38f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.209633 Sep 01 00:35:48.604531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 381/752] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:48 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:48.667482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:48.689720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b1b62d46-d501-45fb-8fcb-a5b8e3d141bc tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.334798 Sep 01 00:35:48.708228 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 372/753] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:48 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:49.615642 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:49.616257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:49.623199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:49.623687 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:49.624119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:49.624932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:49.625378 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:49.625803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:49.716587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:49.717929 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:49.724554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:49.725054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:49.725494 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:49.726309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:49.726765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:49.727361 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:49.855546 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:49.864381 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:49.865834 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:49.866998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e0f0d893-eb0e-41be-aebc-14f91bbd7108 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.255878 Sep 01 00:35:49.867634 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 382/754] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:49 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:49.882183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:49.890788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-72d75311-c68d-49e3-93c8-8cf5bb227ab9 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.179198 Sep 01 00:35:49.891567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 373/755] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:49 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:35:50.891443 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:50.892062 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:50.898965 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:50.899453 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:50.899894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:50.900644 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:50.901100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:50.901848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:50.919075 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:50.921653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:50.929643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:50.930511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:50.931439 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:50.932379 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:50.932859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:50.933401 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:51.067349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:51.077793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:51.079230 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:51.080418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f14f0cd9-90bd-485f-8ed1-26d9fe08963b tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.193128 Sep 01 00:35:51.092531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 383/756] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:50 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:51.155725 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:51.165732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-70f29b6c-3f4c-45eb-bd0c-e127dc89d713 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.250458 Sep 01 00:35:51.180327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 374/757] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:50 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:52.044754 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8f87dced-724e-479b-8966-ffb78dfa651a tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Action: 'create', calling method: .version_select at 0x7fcadff27af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-995150766"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:52.104387 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:52.104948 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:52.111397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:52.112482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:52.112943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:52.113637 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:52.114092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:52.114605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:52.265039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:52.283090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:52.285407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:52.286760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-938edff1-d108-433c-b94f-faee1bd78bfc tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.186351 Sep 01 00:35:52.287790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 375/758] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:52 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:52.302839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:52.303925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:52.311343 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:52.311901 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:52.312403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:52.313206 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:52.313852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:52.314600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:52.412340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8f87dced-724e-479b-8966-ffb78dfa651a tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.488272 Sep 01 00:35:52.416947 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 384/759] 10.222.0.25 () {60 vars in 1155 bytes} [Thu Sep 1 00:35:51 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 493 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 01 00:35:52.427597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c48e342f-0d77-44bc-afcb-54599a77ddd2 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfd759d0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:52.490646 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c48e342f-0d77-44bc-afcb-54599a77ddd2 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 200 len: 344 microversion: 2.1 time: 0.069113 Sep 01 00:35:52.491412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 385/760] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:35:52 2022] GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:52.551849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:52.559615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-de80e5d8-1e86-4c49-a912-2c15f959f472 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1368 microversion: 2.1 time: 0.270613 Sep 01 00:35:52.560184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 376/761] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:52 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1368 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:53.316718 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:53.317330 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:53.323673 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.324247 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.324767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.325844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.326380 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.326802 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.505058 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9ca9650d-ac9d-454e-8298-dfde839fb62a tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfd07ee0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:53.549995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:53.567851 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:53.571320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:53.572586 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-02d60090-0e44-4a34-94d5-a3f75c06b154 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.260578 Sep 01 00:35:53.589323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 386/762] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:53 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:53.600063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:53.600978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:53.609783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.610676 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.611299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.612800 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.613566 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.614506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.616526 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9ca9650d-ac9d-454e-8298-dfde839fb62a tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 200 len: 345 microversion: 2.1 time: 0.115618 Sep 01 00:35:53.617721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 377/763] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:35:53 2022] GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 345 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:53.633513 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-e44c34b5-6266-4ff7-a8c1-65e39aaa3a95 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Action: 'create', calling method: .version_select at 0x7fcadfc9ce50>, body: {"snapshot": {"volume_id": "15813318-2606-47eb-8645-120f1582ccc4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-103136613"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:53.802520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:53.810895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cecdc55b-b4d9-4d73-a9c5-447eee6d87b6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1558 microversion: 2.1 time: 0.219575 Sep 01 00:35:53.811466 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 387/764] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:35:53 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:35:53.817525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-f73ee74f-e183-45b7-9fd6-6dfd8f3fa743 req-1ecd6d25-bd89-4d72-8bf0-3ba6ac698681 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "name": "network-vif-plugged", "status": "completed", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:53.829893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f73ee74f-e183-45b7-9fd6-6dfd8f3fa743 req-1ecd6d25-bd89-4d72-8bf0-3ba6ac698681 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.830940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f73ee74f-e183-45b7-9fd6-6dfd8f3fa743 req-1ecd6d25-bd89-4d72-8bf0-3ba6ac698681 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.831367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-f73ee74f-e183-45b7-9fd6-6dfd8f3fa743 req-1ecd6d25-bd89-4d72-8bf0-3ba6ac698681 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.854232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-f73ee74f-e183-45b7-9fd6-6dfd8f3fa743 req-1ecd6d25-bd89-4d72-8bf0-3ba6ac698681 service nova] Creating event network-vif-plugged:6ad399c9-2cb1-4999-8111-29a8364f2345 for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 on hv-cinder-82002 Sep 01 00:35:53.860843 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-f73ee74f-e183-45b7-9fd6-6dfd8f3fa743 req-1ecd6d25-bd89-4d72-8bf0-3ba6ac698681 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047531 Sep 01 00:35:53.861691 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 388/765] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:53.869599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:53.870069 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:53.880133 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.880879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.881053 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-e44c34b5-6266-4ff7-a8c1-65e39aaa3a95 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.254313 Sep 01 00:35:53.881729 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.881897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 378/766] 10.222.0.25 () {60 vars in 1162 bytes} [Thu Sep 1 00:35:53 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:53.882792 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:53.883397 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:53.883828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:53.893852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7db08cb0-cedc-45ae-9b34-3ead8fe8fe3d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfcd4040>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:53.934367 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7db08cb0-cedc-45ae-9b34-3ead8fe8fe3d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 200 len: 286 microversion: 2.1 time: 0.045467 Sep 01 00:35:53.935474 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 379/767] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:53 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:53.947972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-681361c9-b232-45e1-87e6-98641099ab5d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadffb61f0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:54.022583 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-17e45357-7c7a-4c27-94d8-c8fef199ca06 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.159181 Sep 01 00:35:54.022747 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-681361c9-b232-45e1-87e6-98641099ab5d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.079909 Sep 01 00:35:54.023434 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 380/768] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Sep 1 00:35:53 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:54.023700 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 389/769] 10.222.0.25 () {58 vars in 1275 bytes} [Thu Sep 1 00:35:53 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-interface => generated 285 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:54.036306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-baf7ca59-6640-424b-8dcd-82d3d9b8ee11 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfd75700>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:54.067655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-baf7ca59-6640-424b-8dcd-82d3d9b8ee11 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 200 len: 286 microversion: 2.1 time: 0.035733 Sep 01 00:35:54.068259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 390/770] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:54 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:54.602121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:54.602730 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:54.610805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:54.611302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:54.612285 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:54.613029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:54.613485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:54.613912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:54.855117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:54.865741 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:54.867354 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:54.868611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c8ca4f7b-8265-4373-b12b-eee5095d2c46 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.270538 Sep 01 00:35:54.869187 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 381/771] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:54 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:35:55.081933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-95197190-15f7-4c5c-be88-a9b2fd76bcec tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfe6bf70>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:55.115344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-95197190-15f7-4c5c-be88-a9b2fd76bcec tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 200 len: 286 microversion: 2.1 time: 0.039126 Sep 01 00:35:55.120816 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 391/772] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:55 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:55.656592 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-c9e32fd9-9430-484e-b07f-769b3c86402c req-f92afe3d-b69f-4984-8e78-1367eb904f54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c6cf6ab-6209-485d-b0b0-07e534aff731", "tag": "e8f8c3e3-d46f-4e18-9620-44f218cd1524"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:35:55.666698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c9e32fd9-9430-484e-b07f-769b3c86402c req-f92afe3d-b69f-4984-8e78-1367eb904f54 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:55.667187 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c9e32fd9-9430-484e-b07f-769b3c86402c req-f92afe3d-b69f-4984-8e78-1367eb904f54 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:55.667624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c9e32fd9-9430-484e-b07f-769b3c86402c req-f92afe3d-b69f-4984-8e78-1367eb904f54 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:55.679889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-c9e32fd9-9430-484e-b07f-769b3c86402c req-f92afe3d-b69f-4984-8e78-1367eb904f54 service nova] Creating event network-changed:e8f8c3e3-d46f-4e18-9620-44f218cd1524 for instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 on hv-cinder-82002 Sep 01 00:35:55.685077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-c9e32fd9-9430-484e-b07f-769b3c86402c req-f92afe3d-b69f-4984-8e78-1367eb904f54 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185396 Sep 01 00:35:55.685682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 382/773] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:55.891201 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:55.891812 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:55.899138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:55.899885 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:55.900327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:55.901059 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:55.901679 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:55.902110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:56.054077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:56.062251 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:56.063673 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:56.065913 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0f6ec2e2-c3a9-4241-ae71-c8144ca30948 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.178355 Sep 01 00:35:56.072643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 392/774] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:55 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:56.129491 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5a355819-50e4-4412-ae84-25c2513c7b2c tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfcd4d30>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:56.162247 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5a355819-50e4-4412-ae84-25c2513c7b2c tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 200 len: 286 microversion: 2.1 time: 0.037635 Sep 01 00:35:56.162924 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 383/775] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:56 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:57.088780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:57.089448 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:57.095783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:57.096387 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:57.096911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:57.098537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:57.099057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:57.099545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:57.174691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-827be886-2ce9-40b9-bbc8-ee247f827c3a tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfc9c8b0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:57.207114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-827be886-2ce9-40b9-bbc8-ee247f827c3a tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 200 len: 287 microversion: 2.1 time: 0.036008 Sep 01 00:35:57.213883 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 384/776] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:57 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:35:57.218783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1779eda8-2f52-4ffd-a845-f5a960105e2d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfcff4c0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:57.246344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:57.256248 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:57.257999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:57.259930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-24668565-faca-4b02-af19-be5ed30d7fce tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.175190 Sep 01 00:35:57.260705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 393/777] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:57 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:57.292619 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1779eda8-2f52-4ffd-a845-f5a960105e2d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "DELETE /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 202 len: 0 microversion: 2.1 time: 0.077563 Sep 01 00:35:57.293761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 385/778] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Sep 1 00:35:57 2022] DELETE /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:35:57.301745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e2627907-6fb4-4865-875f-11244d7be747 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfd0bc10>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:57.332959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e2627907-6fb4-4865-875f-11244d7be747 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 200 len: 286 microversion: 2.1 time: 0.034854 Sep 01 00:35:57.338375 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 394/779] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:57 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:58.283897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:58.284864 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:58.292822 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:58.293315 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:58.293806 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:58.294446 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:58.294903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:58.295413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:58.346678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b30eccfa-d302-46f5-b614-dc503865f978 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfd50e50>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:58.392119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-b30eccfa-d302-46f5-b614-dc503865f978 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] HTTP exception thrown: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b30eccfa-d302-46f5-b614-dc503865f978 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Request method failure captured: Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 HTTP/1.1 Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_5n2aF4VCH8yE9sDKCVpHWbJ2PvfSMyVn-QTf2Rr2ZFzKwH7AHaPlPhFKkVQ9NatrHQR8gxqf6ieM53lR636Hn_flt4JUyAbcPNfXbvSq6Zwvu0arsYSdY1ywQ2zI_xcdq9gNyONfLCkFPG-QqwqwwlRJAnEZ0JItcIVnPjl5bqzvs Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:35:58.397140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}] Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 0a6e3415ba5d491c955a9d4e44c99e4b Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'a50faaef-c48a-47af-8fad-a4a34579db74'} Sep 01 00:35:58.398763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. (HTTP 404) (Request-ID: req-0e89860c-7d9a-4e3f-ac54-d3c0c294020a) Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.399905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:35:58.401352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 01 00:35:58.402738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. Sep 01 00:35:58.404147 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:35:58.406259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b30eccfa-d302-46f5-b614-dc503865f978 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Returning 404 to user: Snapshot a50faaef-c48a-47af-8fad-a4a34579db74 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:58.407178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b30eccfa-d302-46f5-b614-dc503865f978 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74" status: 404 len: 111 microversion: 2.1 time: 0.064894 Sep 01 00:35:58.407809 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 395/780] 10.222.0.25 () {58 vars in 1251 bytes} [Thu Sep 1 00:35:58 2022] GET /compute/v2.1/os-snapshots/a50faaef-c48a-47af-8fad-a4a34579db74 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:58.418150 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b45e29df-96b3-4de8-b6b7-bed529f7ccb0 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfe7ddc0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:58.479624 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:58.487762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:58.489286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:58.490450 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f79ca17e-3984-4c04-9db4-16f66146d971 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1729 microversion: 2.20 time: 0.211051 Sep 01 00:35:58.491009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 386/781] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:58 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:35:58.497131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b45e29df-96b3-4de8-b6b7-bed529f7ccb0 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 202 len: 0 microversion: 2.1 time: 0.084448 Sep 01 00:35:58.498563 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 396/782] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:35:58 2022] DELETE /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 01 00:35:58.507088 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-db62e80e-a410-4880-b985-d9f9d1cde3b0 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfca8f70>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:58.557638 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-db62e80e-a410-4880-b985-d9f9d1cde3b0 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 200 len: 344 microversion: 2.1 time: 0.055053 Sep 01 00:35:58.558202 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 387/783] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:35:58 2022] GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:35:59.515554 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:59.516273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:35:59.518449 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:35:59.524398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:59.524923 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:59.525376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:59.526182 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:35:59.526556 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:35:59.526987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:35:59.571986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-288537bc-a059-4f53-9332-6f725a97608d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfcb25e0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:59.603521 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-288537bc-a059-4f53-9332-6f725a97608d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] HTTP exception thrown: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-288537bc-a059-4f53-9332-6f725a97608d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Request method failure captured: Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 HTTP/1.1 Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_5n2aF4VCH8yE9sDKCVpHWbJ2PvfSMyVn-QTf2Rr2ZFzKwH7AHaPlPhFKkVQ9NatrHQR8gxqf6ieM53lR636Hn_flt4JUyAbcPNfXbvSq6Zwvu0arsYSdY1ywQ2zI_xcdq9gNyONfLCkFPG-QqwqwwlRJAnEZ0JItcIVnPjl5bqzvs Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:59.605698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}] Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 0a6e3415ba5d491c955a9d4e44c99e4b Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '15813318-2606-47eb-8645-120f1582ccc4'} Sep 01 00:35:59.607188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. (HTTP 404) (Request-ID: req-e34a1b0a-1f55-43d7-9e6d-29f307d2f5f6) Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.608373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:35:59.609789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 00:35:59.611164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-288537bc-a059-4f53-9332-6f725a97608d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Returning 404 to user: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-288537bc-a059-4f53-9332-6f725a97608d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 404 len: 109 microversion: 2.1 time: 0.039479 Sep 01 00:35:59.613369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 388/784] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:35:59 2022] GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 01 00:35:59.618138 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c80eb83d-b1b1-49c5-a1af-900b0bbdb255 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfcd4ee0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:59.650610 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-c80eb83d-b1b1-49c5-a1af-900b0bbdb255 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] HTTP exception thrown: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c80eb83d-b1b1-49c5-a1af-900b0bbdb255 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Request method failure captured: Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 HTTP/1.1 Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_5n2aF4VCH8yE9sDKCVpHWbJ2PvfSMyVn-QTf2Rr2ZFzKwH7AHaPlPhFKkVQ9NatrHQR8gxqf6ieM53lR636Hn_flt4JUyAbcPNfXbvSq6Zwvu0arsYSdY1ywQ2zI_xcdq9gNyONfLCkFPG-QqwqwwlRJAnEZ0JItcIVnPjl5bqzvs Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:59.652654 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}] Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 0a6e3415ba5d491c955a9d4e44c99e4b Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '15813318-2606-47eb-8645-120f1582ccc4'} Sep 01 00:35:59.653974 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. (HTTP 404) (Request-ID: req-dd7a064e-7ed6-4efc-a162-df01cbbadc8c) Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.654743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 00:35:59.655888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 00:35:59.657033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c80eb83d-b1b1-49c5-a1af-900b0bbdb255 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Returning 404 to user: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c80eb83d-b1b1-49c5-a1af-900b0bbdb255 tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 404 len: 109 microversion: 2.1 time: 0.040616 Sep 01 00:35:59.658372 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 389/785] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:35:59 2022] DELETE /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:35:59.664104 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5f95d46c-4e8f-4550-8ef3-848a0dc5045d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Calling method '.version_select at 0x7fcadfca8430>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:35:59.688058 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:59.693878 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-5f95d46c-4e8f-4550-8ef3-848a0dc5045d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] HTTP exception thrown: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5f95d46c-4e8f-4550-8ef3-848a0dc5045d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Request method failure captured: Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 HTTP/1.1 Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_5n2aF4VCH8yE9sDKCVpHWbJ2PvfSMyVn-QTf2Rr2ZFzKwH7AHaPlPhFKkVQ9NatrHQR8gxqf6ieM53lR636Hn_flt4JUyAbcPNfXbvSq6Zwvu0arsYSdY1ywQ2zI_xcdq9gNyONfLCkFPG-QqwqwwlRJAnEZ0JItcIVnPjl5bqzvs Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:35:59.695866 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/fffe55914dca4883a2a77a2b017e8cde"}]}] Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: fffe55914dca4883a2a77a2b017e8cde Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1355413586 Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 0a6e3415ba5d491c955a9d4e44c99e4b Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1355413586-project Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '15813318-2606-47eb-8645-120f1582ccc4'} Sep 01 00:35:59.697490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. (HTTP 404) (Request-ID: req-a66f96f0-6024-41ed-b0d1-6ecbac0d4d42) Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.698404 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:35:59.699811 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 00:35:59.701454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5f95d46c-4e8f-4550-8ef3-848a0dc5045d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] Returning 404 to user: Volume 15813318-2606-47eb-8645-120f1582ccc4 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5f95d46c-4e8f-4550-8ef3-848a0dc5045d tempest-VolumesSnapshotsTestJSON-1355413586 tempest-VolumesSnapshotsTestJSON-1355413586-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4" status: 404 len: 109 microversion: 2.1 time: 0.037502 Sep 01 00:35:59.702821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 390/786] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:35:59 2022] GET /compute/v2.1/os-volumes/15813318-2606-47eb-8645-120f1582ccc4 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:35:59.710359 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:59.711814 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:35:59.713039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-556b9b71-3e34-4e4f-8caa-d02fdea213f2 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1716 microversion: 2.20 time: 0.201818 Sep 01 00:35:59.713752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 397/787] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:35:59 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1716 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:36:01.161890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-57fc306a-5807-4a94-a7f5-89649963bed9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Action: 'create', calling method: .version_select at 0x7fcae408cca0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1299905299", "metadata": {"Type": "work"}}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-57fc306a-5807-4a94-a7f5-89649963bed9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Request method failure captured: Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 122 Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_5wfsldIKpXgLvGBf940R-0uXxQSfm9VbU3BRvlkMEItXd3UWGOuPynqjanYOSxgMMbPDrIJ_5mfJGzrkcUATab8qLJ-TzrywQOxy-T-yJB-jQd1Az-tHmQgCNhs8uGnHaUTzgtFe8b38IfOd6eWXpPDOM0gtlYsd16WQNpbECzbX0 Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:36:01.171385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}] Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: eac5242e53f140088b8db205399de7c8 Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1299905299", "metadata": {"Type": "work"}}} Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:36:01.173008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1299905299', 'metadata': {'Type': 'work'}}}} Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise error Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi '#$%' Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:01.173825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 00:36:01.175649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 00:36:01.177558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 01 00:36:01.177558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.177558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-57fc306a-5807-4a94-a7f5-89649963bed9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:01.177558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-57fc306a-5807-4a94-a7f5-89649963bed9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.134692 Sep 01 00:36:01.177558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 391/788] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 00:36:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:36:01.183341 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a30db449-6bba-4773-aa39-9b614c8dedd9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Action: 'create', calling method: .version_select at 0x7fcadfd0f310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-601469406", "metadata": {"Type": "work"}}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a30db449-6bba-4773-aa39-9b614c8dedd9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Request method failure captured: Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 119 Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_5wfsldIKpXgLvGBf940R-0uXxQSfm9VbU3BRvlkMEItXd3UWGOuPynqjanYOSxgMMbPDrIJ_5mfJGzrkcUATab8qLJ-TzrywQOxy-T-yJB-jQd1Az-tHmQgCNhs8uGnHaUTzgtFe8b38IfOd6eWXpPDOM0gtlYsd16WQNpbECzbX0 Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:36:01.188033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}] Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: eac5242e53f140088b8db205399de7c8 Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-601469406", "metadata": {"Type": "work"}}} Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: Sep 01 00:36:01.191444 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-601469406', 'metadata': {'Type': 'work'}}}} Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise error Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi '0' Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:01.193277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 00:36:01.194828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 00:36:01.196195 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 01 00:36:01.196195 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.196195 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a30db449-6bba-4773-aa39-9b614c8dedd9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:01.196195 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a30db449-6bba-4773-aa39-9b614c8dedd9 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009969 Sep 01 00:36:01.196195 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 398/789] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 00:36:01 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:36:01.199686 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ca02a8de-d16f-4b94-a3d7-edc236218b80 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Action: 'create', calling method: .version_select at 0x7fcadfc4a550>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1895740081", "metadata": {"Type": "work"}}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ca02a8de-d16f-4b94-a3d7-edc236218b80 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Request method failure captured: Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 119 Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_5wfsldIKpXgLvGBf940R-0uXxQSfm9VbU3BRvlkMEItXd3UWGOuPynqjanYOSxgMMbPDrIJ_5mfJGzrkcUATab8qLJ-TzrywQOxy-T-yJB-jQd1Az-tHmQgCNhs8uGnHaUTzgtFe8b38IfOd6eWXpPDOM0gtlYsd16WQNpbECzbX0 Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:36:01.206143 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}] Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: eac5242e53f140088b8db205399de7c8 Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1895740081", "metadata": {"Type": "work"}}} Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:36:01.208463 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1895740081', 'metadata': {'Type': 'work'}}}} Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise error Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi '' Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:01.209950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 01 00:36:01.211553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 01 00:36:01.212976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 01 00:36:01.212976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.212976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ca02a8de-d16f-4b94-a3d7-edc236218b80 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:01.212976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ca02a8de-d16f-4b94-a3d7-edc236218b80 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011768 Sep 01 00:36:01.212976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 392/790] 10.222.0.25 () {60 vars in 1156 bytes} [Thu Sep 1 00:36:01 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 01 00:36:01.219758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-59d0b967-105d-485e-ad24-d01ac9a07389 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Calling method '.version_select at 0x7fcadfcda9d0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:01.254174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-59d0b967-105d-485e-ad24-d01ac9a07389 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] HTTP exception thrown: Volume tempest-invalid-1029493959 could not be found. Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-59d0b967-105d-485e-ad24-d01ac9a07389 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Request method failure captured: Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1029493959 HTTP/1.1 Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_5wfsldIKpXgLvGBf940R-0uXxQSfm9VbU3BRvlkMEItXd3UWGOuPynqjanYOSxgMMbPDrIJ_5mfJGzrkcUATab8qLJ-TzrywQOxy-T-yJB-jQd1Az-tHmQgCNhs8uGnHaUTzgtFe8b38IfOd6eWXpPDOM0gtlYsd16WQNpbECzbX0 Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:36:01.256621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}] Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: eac5242e53f140088b8db205399de7c8 Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Volume tempest-invalid-1029493959 could not be found. Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'tempest-invalid-1029493959'} Sep 01 00:36:01.258203 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1029493959 could not be found. (HTTP 404) (Request-ID: req-41f1b33a-a263-4e72-9719-5827b7f01f13) Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.259019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 00:36:01.260131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1029493959 could not be found. Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:01.261268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1029493959 could not be found. Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1029493959 could not be found. Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-59d0b967-105d-485e-ad24-d01ac9a07389 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Returning 404 to user: Volume tempest-invalid-1029493959 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-59d0b967-105d-485e-ad24-d01ac9a07389 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1029493959" status: 404 len: 99 microversion: 2.1 time: 0.043135 Sep 01 00:36:01.262467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 399/791] 10.222.0.25 () {58 vars in 1218 bytes} [Thu Sep 1 00:36:01 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1029493959 => generated 99 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 01 00:36:01.268102 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-62f12e4f-12aa-4f21-927d-724cdff98c36 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003760 Sep 01 00:36:01.268615 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 393/792] 10.222.0.25 () {58 vars in 1140 bytes} [Thu Sep 1 00:36:01 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 00:36:01.280344 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-db5cd9bc-e713-4286-8885-d14d484f2edf tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005199 Sep 01 00:36:01.280987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 400/793] 10.222.0.25 () {58 vars in 1137 bytes} [Thu Sep 1 00:36:01 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 01 00:36:01.290801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-075a4d85-6d8a-436c-b9b1-14967140c0f3 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Calling method '.version_select at 0x7fcadfd460d0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:01.318969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-075a4d85-6d8a-436c-b9b1-14967140c0f3 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] HTTP exception thrown: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-075a4d85-6d8a-436c-b9b1-14967140c0f3 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Request method failure captured: Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/os-volumes/dd4de31b-38c2-471e-bef9-550bfb1b7097 HTTP/1.1 Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_5wfsldIKpXgLvGBf940R-0uXxQSfm9VbU3BRvlkMEItXd3UWGOuPynqjanYOSxgMMbPDrIJ_5mfJGzrkcUATab8qLJ-TzrywQOxy-T-yJB-jQd1Az-tHmQgCNhs8uGnHaUTzgtFe8b38IfOd6eWXpPDOM0gtlYsd16WQNpbECzbX0 Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:36:01.321129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}] Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: eac5242e53f140088b8db205399de7c8 Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'dd4de31b-38c2-471e-bef9-550bfb1b7097'} Sep 01 00:36:01.322852 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. (HTTP 404) (Request-ID: req-9794ec39-1030-4cd9-b858-6521f01333c5) Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.328904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 01 00:36:01.330359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 01 00:36:01.331902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-075a4d85-6d8a-436c-b9b1-14967140c0f3 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Returning 404 to user: Volume dd4de31b-38c2-471e-bef9-550bfb1b7097 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-075a4d85-6d8a-436c-b9b1-14967140c0f3 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "DELETE /compute/v2.1/os-volumes/dd4de31b-38c2-471e-bef9-550bfb1b7097" status: 404 len: 109 microversion: 2.1 time: 0.035749 Sep 01 00:36:01.333410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 394/794] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:36:01 2022] DELETE /compute/v2.1/os-volumes/dd4de31b-38c2-471e-bef9-550bfb1b7097 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:36:01.338469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a0f5eb9e-5b03-45ab-9dd4-c7e05c79c484 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Calling method '.version_select at 0x7fcadfd0f280>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:01.367382 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-a0f5eb9e-5b03-45ab-9dd4-c7e05c79c484 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] HTTP exception thrown: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a0f5eb9e-5b03-45ab-9dd4-c7e05c79c484 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Request method failure captured: Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/os-volumes/f7792f29-5db7-4e0d-bd13-e1feb6f021ef HTTP/1.1 Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_5wfsldIKpXgLvGBf940R-0uXxQSfm9VbU3BRvlkMEItXd3UWGOuPynqjanYOSxgMMbPDrIJ_5mfJGzrkcUATab8qLJ-TzrywQOxy-T-yJB-jQd1Az-tHmQgCNhs8uGnHaUTzgtFe8b38IfOd6eWXpPDOM0gtlYsd16WQNpbECzbX0 Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:36:01.369395 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/888f7e6604a24b0485f3f10fac3e300f"}]}] Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 888f7e6604a24b0485f3f10fac3e300f Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-VolumesNegativeTest-162966435 Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: eac5242e53f140088b8db205399de7c8 Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-VolumesNegativeTest-162966435-project Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'f7792f29-5db7-4e0d-bd13-e1feb6f021ef'} Sep 01 00:36:01.371103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. (HTTP 404) (Request-ID: req-7b3738c2-ce17-4ac1-ad55-21b2c6622c52) Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.380766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 01 00:36:01.382100 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 01 00:36:01.383601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a0f5eb9e-5b03-45ab-9dd4-c7e05c79c484 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] Returning 404 to user: Volume f7792f29-5db7-4e0d-bd13-e1feb6f021ef could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a0f5eb9e-5b03-45ab-9dd4-c7e05c79c484 tempest-VolumesNegativeTest-162966435 tempest-VolumesNegativeTest-162966435-project] 10.222.0.25 "GET /compute/v2.1/os-volumes/f7792f29-5db7-4e0d-bd13-e1feb6f021ef" status: 404 len: 109 microversion: 2.1 time: 0.039376 Sep 01 00:36:01.385063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 401/795] 10.222.0.25 () {58 vars in 1245 bytes} [Thu Sep 1 00:36:01 2022] GET /compute/v2.1/os-volumes/f7792f29-5db7-4e0d-bd13-e1feb6f021ef => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:36:28.447634 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:28.448414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:28.449435 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=53 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:28.452643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=78 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:28.456974 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-97f0b12c-6831-4430-bbf5-8e0cc09889f6 req-5bd4219c-e39f-4575-9ef1-bef2d4a15da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:28.464545 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:28.465861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:28.478531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-97f0b12c-6831-4430-bbf5-8e0cc09889f6 req-5bd4219c-e39f-4575-9ef1-bef2d4a15da0 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:28.478934 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-97f0b12c-6831-4430-bbf5-8e0cc09889f6 req-5bd4219c-e39f-4575-9ef1-bef2d4a15da0 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:28.479370 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-97f0b12c-6831-4430-bbf5-8e0cc09889f6 req-5bd4219c-e39f-4575-9ef1-bef2d4a15da0 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:28.483630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:28.484169 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:28.485496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:28.486230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:28.486689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:28.487115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:28.492008 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-97f0b12c-6831-4430-bbf5-8e0cc09889f6 req-5bd4219c-e39f-4575-9ef1-bef2d4a15da0 service nova] Creating event network-changed:7e1bd795-ba93-4500-a63a-3a150fd97453 for instance 12865e9d-801f-4fc9-a160-3628da11fe30 on hv-cinder-82002 Sep 01 00:36:28.497122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-97f0b12c-6831-4430-bbf5-8e0cc09889f6 req-5bd4219c-e39f-4575-9ef1-bef2d4a15da0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053056 Sep 01 00:36:28.497715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 402/796] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:36:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:36:28.515496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:36:28.598461 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d6bf32a1-1b54-40c2-bb2d-bd74262bb797 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "DELETE /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 204 len: 0 microversion: 2.1 time: 0.157575 Sep 01 00:36:28.602137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 395/797] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:36:28 2022] DELETE /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:36:28.610174 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:28.610865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:28.617608 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:28.618327 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:28.618768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:28.619474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:28.619929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:28.620357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:28.762692 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:28.770492 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2cbeb656-9851-4fa5-bbce-e26327d520eb tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.164409 Sep 01 00:36:28.783911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 403/798] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:36:28 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:36:29.792213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:29.792849 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:29.799146 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:29.799626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:29.800061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:29.800781 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:29.801234 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:29.801737 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:29.969702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:29.978273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-688ff2c6-e56a-4cc1-84d2-8c8e282bc9c6 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1570 microversion: 2.1 time: 0.190345 Sep 01 00:36:29.978839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 396/799] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:36:29 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1570 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:36:30.948719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-9e1f9d8f-0724-49e0-a436-3de9882fa5bf req-b28d872f-d2b9-4eb9-b9dd-23952043f739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12865e9d-801f-4fc9-a160-3628da11fe30", "name": "network-vif-deleted", "tag": "7e1bd795-ba93-4500-a63a-3a150fd97453"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:30.961180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9e1f9d8f-0724-49e0-a436-3de9882fa5bf req-b28d872f-d2b9-4eb9-b9dd-23952043f739 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:30.961655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9e1f9d8f-0724-49e0-a436-3de9882fa5bf req-b28d872f-d2b9-4eb9-b9dd-23952043f739 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:30.962263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-9e1f9d8f-0724-49e0-a436-3de9882fa5bf req-b28d872f-d2b9-4eb9-b9dd-23952043f739 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:30.975371 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-9e1f9d8f-0724-49e0-a436-3de9882fa5bf req-b28d872f-d2b9-4eb9-b9dd-23952043f739 service nova] Creating event network-vif-deleted:7e1bd795-ba93-4500-a63a-3a150fd97453 for instance 12865e9d-801f-4fc9-a160-3628da11fe30 on hv-cinder-82002 Sep 01 00:36:30.982480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-9e1f9d8f-0724-49e0-a436-3de9882fa5bf req-b28d872f-d2b9-4eb9-b9dd-23952043f739 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037910 Sep 01 00:36:30.983111 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 404/800] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:36:31.002427 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:31.004098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:31.011540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:31.012031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:31.012471 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:31.013199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:31.013651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:31.014069 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:31.080346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0e23f782c74c5d896ab24b64b43b18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f39cdb9221440658d7cd52c341cf08a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:31.088834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-94a5134c-21e2-4c64-924f-57893361d518 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 200 len: 1220 microversion: 2.1 time: 0.090827 Sep 01 00:36:31.102688 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 397/801] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:36:30 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 1220 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:36:32.110820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:32.111515 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] [instance: 12865e9d-801f-4fc9-a160-3628da11fe30] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:32.119441 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:32.119932 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:32.120367 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:32.121143 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:32.121597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:32.122041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:32.135880 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] HTTP exception thrown: Instance 12865e9d-801f-4fc9-a160-3628da11fe30 could not be found. Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Request method failure captured: Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 HTTP/1.1 Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1J-QNCr5kvC1v-5Py9U5Qlr7hLYPz52Jivou58kN0TWEcrFuGj3mhLDXiXnmUKuOsrRUoZefhhZ_ryK7d0YzATxsM43AVRFLdH5p_WcLGVcHvzlxyXdbzHl72WEXSE2Vrj4RlbYIR-2btg6tCJJ-zbnx2z3des0GzPwSPnt9r2UEw Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 3f39cdb9221440658d7cd52c341cf08a Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-TestShelveInstance-1451357253 Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:36:32.137698 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_3f39cdb9221440658d7cd52c341cf08a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/3f39cdb9221440658d7cd52c341cf08a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f39cdb9221440658d7cd52c341cf08a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/3f39cdb9221440658d7cd52c341cf08a"}]}] Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-TestShelveInstance-1451357253 Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 3f39cdb9221440658d7cd52c341cf08a Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-TestShelveInstance-1451357253 Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-TestShelveInstance-1451357253-project Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: af0e23f782c74c5d896ab24b64b43b18 Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-TestShelveInstance-1451357253-project Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 12865e9d-801f-4fc9-a160-3628da11fe30 could not be found. Sep 01 00:36:32.139332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '12865e9d-801f-4fc9-a160-3628da11fe30'} Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12865e9d-801f-4fc9-a160-3628da11fe30 could not be found. Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:32.140274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12865e9d-801f-4fc9-a160-3628da11fe30 could not be found. Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12865e9d-801f-4fc9-a160-3628da11fe30 could not be found. Sep 01 00:36:32.142169 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:32.143847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Returning 404 to user: Instance 12865e9d-801f-4fc9-a160-3628da11fe30 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:32.143847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d4ffe19d-6f08-4e7f-b3c5-4fe4db823ba1 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30" status: 404 len: 111 microversion: 2.1 time: 0.033476 Sep 01 00:36:32.146316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 405/802] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:36:32 2022] GET /compute/v2.1/servers/12865e9d-801f-4fc9-a160-3628da11fe30 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:36:32.319759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d4f92c7-c30b-4161-a79a-0e24ce22cd25 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] Calling method '.version_select at 0x7fcadfcd49d0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:32.372438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5d4f92c7-c30b-4161-a79a-0e24ce22cd25 tempest-TestShelveInstance-1451357253 tempest-TestShelveInstance-1451357253-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1494052932" status: 202 len: 0 microversion: 2.1 time: 0.057325 Sep 01 00:36:32.373166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 398/803] 10.222.0.25 () {58 vars in 1254 bytes} [Thu Sep 1 00:36:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1494052932 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:36:39.614730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:39.615560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:39.632705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:39.634553 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:39.635021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:39.641148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:39.642866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:39.643617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:39.706093 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-516e4d13-ddf2-4c29-b9fa-9018db7798a8 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/ips" status: 200 len: 149 microversion: 2.1 time: 0.455726 Sep 01 00:36:39.714263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 406/804] 10.222.0.25 () {58 vars in 1248 bytes} [Thu Sep 1 00:36:39 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/ips => generated 149 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:36:42.553633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:42.554430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:42.558797 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:42.560950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:42.568887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:42.569399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:42.569910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:42.570608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:42.571067 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:42.571492 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:42.603274 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3764270b-de15-4d49-9dcb-3289088a7131 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051640 Sep 01 00:36:42.603826 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 399/805] 10.222.0.25 () {60 vars in 1343 bytes} [Thu Sep 1 00:36:42 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:36:42.664282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:42.664835 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:42.671390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:42.671901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:42.672413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:42.673189 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:42.673636 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:42.674055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:42.700031 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:36:42.774844 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-72b163dd-e4e9-41a6-b8dd-a9bfb8e519bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 204 len: 0 microversion: 2.20 time: 0.114594 Sep 01 00:36:42.775613 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 407/806] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 00:36:42 2022] DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 01 00:36:42.787328 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:42.787941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:42.795331 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:42.796103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:42.796788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:42.797617 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:42.798176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:42.798787 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:42.937763 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:42.946979 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:42.948459 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:42.950086 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc002026-970e-4d1a-abf8-eff4dd532b9f tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.169563 Sep 01 00:36:42.950755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 400/807] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:42 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:36:43.305286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc16f473-08e2-47f6-b189-b05bf63ae1a9"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:43.307840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:43.314170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:43.314660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:43.315130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:43.315865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:43.316318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:43.317513 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:43.974197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:43.974905 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:43.981586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:43.982060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:43.982489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:43.983172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:43.983618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:43.984040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:44.112936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:44.121574 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:44.122987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:44.124127 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-56518af0-6429-4b44-bce2-0b0f633260aa tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.154339 Sep 01 00:36:44.124708 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 401/808] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:43 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:36:45.148762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:45.149414 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:45.155765 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:45.156220 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:45.156618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:45.157313 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:45.157760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:45.158182 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:45.287566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:45.295620 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:45.297090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:45.298256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5909fd13-58a4-43d3-9f80-87c915532b14 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.153676 Sep 01 00:36:45.299133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 402/809] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:45 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 01 00:36:46.291308 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-66f924a6-2a25-4179-9fc3-1e6fab340504 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "POST /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.990470 Sep 01 00:36:46.292019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 408/810] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:36:43 2022] POST /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments => generated 194 bytes in 2992 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:36:46.322389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:46.323561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:46.331667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:46.332164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:46.333483 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:46.334227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:46.334671 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:46.335105 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:46.513126 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:46.523802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:46.525889 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:46.527430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc8b7f3c-a038-4ab7-8800-265b37bd5800 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1722 microversion: 2.20 time: 0.208905 Sep 01 00:36:46.528628 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 403/811] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:46 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:36:47.553144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:47.554352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:47.562053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:47.562544 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:47.563046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:47.563785 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:47.564241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:47.564703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:47.643745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:47.653130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:47.654778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:47.656067 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-506e3f71-3512-4ef5-ba8b-e0f47afd0409 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1654 microversion: 2.20 time: 0.108479 Sep 01 00:36:47.656927 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 409/812] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:47 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1654 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:36:47.692789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-495fa128-d264-45b7-b31e-a83b59c320f0 req-86c537c6-a859-4abc-9426-8af770ad63af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7144cea0-9e9b-42cb-8aa2-7012ad723c39", "name": "network-vif-deleted", "tag": "6ad399c9-2cb1-4999-8111-29a8364f2345"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:36:47.704808 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-495fa128-d264-45b7-b31e-a83b59c320f0 req-86c537c6-a859-4abc-9426-8af770ad63af service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:47.705281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-495fa128-d264-45b7-b31e-a83b59c320f0 req-86c537c6-a859-4abc-9426-8af770ad63af service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:47.705731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-495fa128-d264-45b7-b31e-a83b59c320f0 req-86c537c6-a859-4abc-9426-8af770ad63af service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:47.717850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-495fa128-d264-45b7-b31e-a83b59c320f0 req-86c537c6-a859-4abc-9426-8af770ad63af service nova] Creating event network-vif-deleted:6ad399c9-2cb1-4999-8111-29a8364f2345 for instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 on hv-cinder-82002 Sep 01 00:36:47.722769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-495fa128-d264-45b7-b31e-a83b59c320f0 req-86c537c6-a859-4abc-9426-8af770ad63af service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034101 Sep 01 00:36:47.723595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 404/813] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:36:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:36:48.680092 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:48.680743 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:48.687258 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:48.687735 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:48.688164 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:48.688928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:48.689373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:48.689801 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:48.758594 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:48.768386 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:48.770904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:48.772107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3f829149-d4d9-448a-8a14-5837ec856f08 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1365 microversion: 2.20 time: 0.096680 Sep 01 00:36:48.772719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 410/814] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:48 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:36:49.795376 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:49.796099 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:49.803237 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:49.803710 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:49.804140 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:49.804858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:49.805362 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:49.805785 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:49.837172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:49.837648 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:49.838080 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:49.838669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.objects.instance [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lazy-loading 'fault' on Instance uuid 7144cea0-9e9b-42cb-8aa2-7012ad723c39 {{(pid=132498) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:36:49.883156 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:49.891242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:49.892705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ecf29db866eb43fa954b0d440577f45f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06942912e37346eaa2310a56b84f3886', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:36:49.893844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-866ca60f-eed0-4486-a1ba-2297896a66f9 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 200 len: 1370 microversion: 2.20 time: 0.102628 Sep 01 00:36:49.894444 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 405/815] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:49 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 01 00:36:50.916826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:50.917402 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:50.923867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:50.924353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:50.924831 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:50.925532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:50.927531 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:50.928004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:50.941182 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] HTTP exception thrown: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Request method failure captured: Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 HTTP/1.1 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0Jto_idGse7KpaAJGiE0NW6NXnax9XMQgF0dH0WgElnn35jvhkJ4SuXzChwbaN9OaobEaS9qgjmPIQtpBdgTHg-hy5CjBRRUptSIIvjmvkfHORGVDAe_fCxUzqIhf8C8hJdrHrc-dwza_jwGcl7QAh9iWw7Wb6PE8huUc7l_bXyww Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:36:50.943786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06942912e37346eaa2310a56b84f3886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06942912e37346eaa2310a56b84f3886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}] Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: ecf29db866eb43fa954b0d440577f45f Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:50.945939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '7144cea0-9e9b-42cb-8aa2-7012ad723c39'} Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:50.947268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:50.949396 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:50.950847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Returning 404 to user: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:50.950847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0d840df4-51d5-4823-9682-0e8a33bce9ef tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 404 len: 111 microversion: 2.20 time: 0.032397 Sep 01 00:36:50.950847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 411/816] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:50 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:36:50.954315 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-05644082-9bc5-4ac5-b18a-501eceddd340 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '.version_select at 0x7fcadfcb29d0>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:50.973171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-05644082-9bc5-4ac5-b18a-501eceddd340 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-376637948" status: 204 len: 0 microversion: 2.20 time: 0.022494 Sep 01 00:36:50.973944 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 406/817] 10.222.0.25 () {60 vars in 1259 bytes} [Thu Sep 1 00:36:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-376637948 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 01 00:36:54.908552 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:54.909054 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:54.916340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:54.916866 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:54.917303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:54.918185 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:54.918638 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:54.919063 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:54.932972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] HTTP exception thrown: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Request method failure captured: Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 HTTP/1.1 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_0Jto_idGse7KpaAJGiE0NW6NXnax9XMQgF0dH0WgElnn35jvhkJ4SuXzChwbaN9OaobEaS9qgjmPIQtpBdgTHg-hy5CjBRRUptSIIvjmvkfHORGVDAe_fCxUzqIhf8C8hJdrHrc-dwza_jwGcl7QAh9iWw7Wb6PE8huUc7l_bXyww Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:36:54.934665 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06942912e37346eaa2310a56b84f3886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06942912e37346eaa2310a56b84f3886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}] Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: ecf29db866eb43fa954b0d440577f45f Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.936393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '7144cea0-9e9b-42cb-8aa2-7012ad723c39'} Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:54.937320 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.938804 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.940170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Returning 404 to user: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:54.940170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0c4b0c78-ae5e-411c-89cc-167cf490a3ad tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 404 len: 111 microversion: 2.20 time: 0.031339 Sep 01 00:36:54.940170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 412/818] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 00:36:54 2022] DELETE /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:36:54.945793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:54.946407 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 7144cea0-9e9b-42cb-8aa2-7012ad723c39] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:54.953366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:54.953855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:54.954286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:54.954977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:54.955422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:54.955844 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:54.969619 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] HTTP exception thrown: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Request method failure captured: Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 HTTP/1.1 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0Jto_idGse7KpaAJGiE0NW6NXnax9XMQgF0dH0WgElnn35jvhkJ4SuXzChwbaN9OaobEaS9qgjmPIQtpBdgTHg-hy5CjBRRUptSIIvjmvkfHORGVDAe_fCxUzqIhf8C8hJdrHrc-dwza_jwGcl7QAh9iWw7Wb6PE8huUc7l_bXyww Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:36:54.971415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06942912e37346eaa2310a56b84f3886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06942912e37346eaa2310a56b84f3886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}] Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: ecf29db866eb43fa954b0d440577f45f Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.973669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '7144cea0-9e9b-42cb-8aa2-7012ad723c39'} Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:54.974512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. Sep 01 00:36:54.976002 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:54.977704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Returning 404 to user: Instance 7144cea0-9e9b-42cb-8aa2-7012ad723c39 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:54.977704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f598692a-5dd2-473e-9e99-a1b3d42c82bf tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39" status: 404 len: 111 microversion: 2.20 time: 0.032230 Sep 01 00:36:54.977704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 407/819] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:54 2022] GET /compute/v2.1/servers/7144cea0-9e9b-42cb-8aa2-7012ad723c39 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:36:59.258504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:59.259002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:59.261662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:59.267808 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.268296 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.268771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.269480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.269931 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.270867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.275528 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:36:59.291556 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:59.293235 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:59.301201 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.301962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.302622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.303510 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.304159 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.304678 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.325359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] HTTP exception thrown: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Request method failure captured: Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a HTTP/1.1 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0Jto_idGse7KpaAJGiE0NW6NXnax9XMQgF0dH0WgElnn35jvhkJ4SuXzChwbaN9OaobEaS9qgjmPIQtpBdgTHg-hy5CjBRRUptSIIvjmvkfHORGVDAe_fCxUzqIhf8C8hJdrHrc-dwza_jwGcl7QAh9iWw7Wb6PE8huUc7l_bXyww Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:36:59.326976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06942912e37346eaa2310a56b84f3886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06942912e37346eaa2310a56b84f3886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}] Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: ecf29db866eb43fa954b0d440577f45f Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.328749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '17b64cab-6c29-4261-b029-bf0bb5d3ee9a'} Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:59.329676 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.331172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.332729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Returning 404 to user: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:59.332729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-542b53d2-4d24-41a5-bc6b-3ff559e036eb tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 404 len: 111 microversion: 2.20 time: 0.043579 Sep 01 00:36:59.332729 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 408/820] 10.222.0.25 () {60 vars in 1280 bytes} [Thu Sep 1 00:36:59 2022] DELETE /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 01 00:36:59.340077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:59.340808 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] [instance: 17b64cab-6c29-4261-b029-bf0bb5d3ee9a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:59.347326 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.348010 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.349270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.349755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.350370 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.350783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.366508 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] HTTP exception thrown: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Request method failure captured: Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a HTTP/1.1 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_0Jto_idGse7KpaAJGiE0NW6NXnax9XMQgF0dH0WgElnn35jvhkJ4SuXzChwbaN9OaobEaS9qgjmPIQtpBdgTHg-hy5CjBRRUptSIIvjmvkfHORGVDAe_fCxUzqIhf8C8hJdrHrc-dwza_jwGcl7QAh9iWw7Wb6PE8huUc7l_bXyww Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Openstack-Nova-Api-Version: 2.20 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:36:59.368216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_06942912e37346eaa2310a56b84f3886"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/06942912e37346eaa2310a56b84f3886"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/06942912e37346eaa2310a56b84f3886"}]}] Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 06942912e37346eaa2310a56b84f3886 Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-842026825 Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: ecf29db866eb43fa954b0d440577f45f Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeShelveTestJSON-842026825-project Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.369853 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '17b64cab-6c29-4261-b029-bf0bb5d3ee9a'} Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:36:59.370666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. Sep 01 00:36:59.372090 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:36:59.373478 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] Returning 404 to user: Instance 17b64cab-6c29-4261-b029-bf0bb5d3ee9a could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:36:59.373478 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-da812f24-0697-49f3-84fb-92fdb38521f5 tempest-AttachVolumeShelveTestJSON-842026825 tempest-AttachVolumeShelveTestJSON-842026825-project] 10.222.0.25 "GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a" status: 404 len: 111 microversion: 2.20 time: 0.033488 Sep 01 00:36:59.373478 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 409/821] 10.222.0.25 () {60 vars in 1277 bytes} [Thu Sep 1 00:36:59 2022] GET /compute/v2.1/servers/17b64cab-6c29-4261-b029-bf0bb5d3ee9a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 01 00:36:59.375929 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lazy-loading 'services' on Instance uuid 8c6cf6ab-6209-485d-b0b0-07e534aff731 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:36:59.461779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ff273009-90e6-4246-83e1-b8940e0f2e67 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments/fc16f473-08e2-47f6-b189-b05bf63ae1a9" status: 202 len: 0 microversion: 2.1 time: 0.209484 Sep 01 00:36:59.462504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 413/822] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:36:59 2022] DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments/fc16f473-08e2-47f6-b189-b05bf63ae1a9 => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:36:59.470946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:36:59.474342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:36:59.482085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.482584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.483025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.484173 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:36:59.484670 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:36:59.485108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:36:59.528389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b08d8b02-aaa9-47fb-a5a7-2570a0267a11 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061665 Sep 01 00:36:59.529004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 410/823] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:36:59 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:37:00.543149 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:00.546683 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:00.556364 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:00.556944 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:00.557385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:00.558102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:00.558551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:00.559171 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:00.593892 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6cbf30a5-0048-4736-85ea-278e165246ee tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056367 Sep 01 00:37:00.594737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 414/824] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:37:00 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:37:00.671116 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:00.672240 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:00.680756 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:00.681485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:00.682061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:00.682922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:00.683691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:00.684196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:00.716470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:37:00.816567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2b53e2e2-08aa-48a5-b29b-df7354543d08 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 204 len: 0 microversion: 2.1 time: 0.150398 Sep 01 00:37:00.818097 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 411/825] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:37:00 2022] DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:37:00.826306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:00.827018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:00.834380 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:00.834955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:00.835469 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:00.836242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:00.836797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:00.837292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:01.059413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:01.073070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-03096991-3e7f-4b31-8b46-bd2b61599402 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1682 microversion: 2.1 time: 0.250659 Sep 01 00:37:01.074216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 415/826] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:00 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1682 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:02.104467 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:02.108119 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:02.115595 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:02.116286 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:02.116918 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:02.117820 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:02.118269 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:02.118696 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:02.308552 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:02.319554 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5aa1590b-b705-47db-ae25-974c6160a255 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1682 microversion: 2.1 time: 0.219434 Sep 01 00:37:02.320743 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 412/827] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:02 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1682 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:03.344384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:03.345148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:03.352890 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:03.353525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:03.354038 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:03.354819 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:03.355457 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:03.355892 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:03.701968 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:03.714914 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-def89b0b-3dd4-4442-b0a4-1d654fb237a4 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1682 microversion: 2.1 time: 0.374000 Sep 01 00:37:03.715738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 416/828] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:03 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1682 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:04.646015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-37c5f9f7-3e5f-43d8-9b3b-ef728091ffe7 req-bcd5100e-ba6b-49c8-ba8a-e00556b1de61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c6cf6ab-6209-485d-b0b0-07e534aff731", "name": "network-vif-deleted", "tag": "e8f8c3e3-d46f-4e18-9620-44f218cd1524"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:37:04.669943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-37c5f9f7-3e5f-43d8-9b3b-ef728091ffe7 req-bcd5100e-ba6b-49c8-ba8a-e00556b1de61 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:04.670667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-37c5f9f7-3e5f-43d8-9b3b-ef728091ffe7 req-bcd5100e-ba6b-49c8-ba8a-e00556b1de61 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:04.671283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-37c5f9f7-3e5f-43d8-9b3b-ef728091ffe7 req-bcd5100e-ba6b-49c8-ba8a-e00556b1de61 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:04.683612 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-37c5f9f7-3e5f-43d8-9b3b-ef728091ffe7 req-bcd5100e-ba6b-49c8-ba8a-e00556b1de61 service nova] Creating event network-vif-deleted:e8f8c3e3-d46f-4e18-9620-44f218cd1524 for instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 on hv-cinder-82002 Sep 01 00:37:04.689946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-37c5f9f7-3e5f-43d8-9b3b-ef728091ffe7 req-bcd5100e-ba6b-49c8-ba8a-e00556b1de61 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048028 Sep 01 00:37:04.691605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 413/829] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:37:04.737862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:04.740071 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:04.746959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:04.747770 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:04.748433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:04.749662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:04.750324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:04.750973 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:04.890230 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7a36e4630904f4eac08c9de1b8235ca', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bcb33a579e47518fafa960505447dc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:04.906545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-503e558b-d2d5-4796-98a2-e18f139f2d0a tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 200 len: 1327 microversion: 2.1 time: 0.172414 Sep 01 00:37:04.908658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 417/830] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:04 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 1327 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:05.932697 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:05.933391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:05.939857 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:05.940341 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:05.941223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:05.941478 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:05.943107 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:05.943847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:05.959989 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 HTTP/1.1 Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:37:05.961506 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:05.962916 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '8c6cf6ab-6209-485d-b0b0-07e534aff731'} Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:05.963777 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:05.965061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:05.966183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:05.966183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c508dc5b-ef8c-4c33-915c-e0244f922768 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 404 len: 111 microversion: 2.1 time: 0.035252 Sep 01 00:37:05.966183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 414/831] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:05 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:05.973080 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-53b536ce-2518-4476-824a-5bb2d396c9fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '.version_select at 0x7fcadfdbb4c0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:06.013413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-53b536ce-2518-4476-824a-5bb2d396c9fb tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023529543" status: 202 len: 0 microversion: 2.1 time: 0.045150 Sep 01 00:37:06.014215 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 418/832] 10.222.0.25 () {58 vars in 1221 bytes} [Thu Sep 1 00:37:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2023529543 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:37:06.667137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-244440642", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "networks": [{"uuid": "7d63a16c-5384-4138-a6eb-6c8ecb267ec2"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:37:06.733288 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] validate_networks() for [('7d63a16c-5384-4138-a6eb-6c8ecb267ec2', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:37:07.437985 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:37:07.438577 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:37:07.439118 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:37:07.439550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:37:07.439962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:37:07.449340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:07.449816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:07.450260 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:07.450968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:07.451417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:07.451839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:07.471954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Getting quotas for project 07af35e80c004621bd72ab7336930693. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:37:07.476577 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Getting quotas for user 7d042aa1a703464eab4a440db9ce1374 and project 07af35e80c004621bd72ab7336930693. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:37:07.487377 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:37:07.490285 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:37:07.538910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b78200de-5018-4f60-8001-a510dcc2bf0d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.875391 Sep 01 00:37:07.545420 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 415/833] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:37:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:37:07.550852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-93096d09-8692-442d-bbf3-a35e5b41e46b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:07.552295 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-93096d09-8692-442d-bbf3-a35e5b41e46b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:07.640865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-93096d09-8692-442d-bbf3-a35e5b41e46b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:07.650228 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-93096d09-8692-442d-bbf3-a35e5b41e46b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1218 microversion: 2.1 time: 0.103277 Sep 01 00:37:07.665439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 419/834] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:07 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:07.856459 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:07.857099 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:07.865115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:07.866102 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:07.866761 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:07.867784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:07.868243 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:07.868704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:07.885605 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 HTTP/1.1 Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:37:07.887922 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.889277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '8c6cf6ab-6209-485d-b0b0-07e534aff731'} Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:07.890242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.891457 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.892736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:07.892736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2dc60bf6-8cd5-4889-92db-0c4e050e30f6 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 404 len: 111 microversion: 2.1 time: 0.037591 Sep 01 00:37:07.892736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 416/835] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:37:07 2022] DELETE /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:07.899260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:07.900009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 8c6cf6ab-6209-485d-b0b0-07e534aff731] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:07.906651 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:07.907143 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:07.907751 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:07.908654 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:07.909194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:07.909560 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:07.925165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 HTTP/1.1 Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:37:07.928011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.929607 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '8c6cf6ab-6209-485d-b0b0-07e534aff731'} Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:07.930432 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. Sep 01 00:37:07.931848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:07.933376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance 8c6cf6ab-6209-485d-b0b0-07e534aff731 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:07.933376 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-aaed737e-0b96-419a-bce1-064d00db9422 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731" status: 404 len: 111 microversion: 2.1 time: 0.035336 Sep 01 00:37:07.936140 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 420/836] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:07 2022] GET /compute/v2.1/servers/8c6cf6ab-6209-485d-b0b0-07e534aff731 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:08.671783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:08.673026 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:08.679767 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:08.680559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:08.681159 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:08.682083 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:08.682684 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:08.683270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:08.760272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:08.769208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1604d08d-1465-45ba-95d6-bdad047f4480 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1278 microversion: 2.1 time: 0.101766 Sep 01 00:37:08.770828 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 417/837] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:08 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1278 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:09.089222 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:09.089767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:09.097474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.098006 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.098647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.099527 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.099980 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.100422 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.115879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 HTTP/1.1 Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:37:09.117797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.119281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'ddd521ac-53c1-4789-94b2-c2fd1fa62bf5'} Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:09.120049 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.121912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.123094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:09.123094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0c750af0-8ddb-402b-91c2-e8e12ab22269 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 404 len: 111 microversion: 2.1 time: 0.035876 Sep 01 00:37:09.123094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 421/838] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:37:09 2022] DELETE /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:09.128161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:09.128800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: ddd521ac-53c1-4789-94b2-c2fd1fa62bf5] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:09.135802 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.136293 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.136771 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.137473 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.137925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.138342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.305944 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 HTTP/1.1 Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:37:09.307501 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.309250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'ddd521ac-53c1-4789-94b2-c2fd1fa62bf5'} Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:09.310211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. Sep 01 00:37:09.311703 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.313194 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:09.313194 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7a738cda-583d-4c69-bd1b-120759a56856 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5" status: 404 len: 111 microversion: 2.1 time: 0.184638 Sep 01 00:37:09.316745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 418/839] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:09 2022] GET /compute/v2.1/servers/ddd521ac-53c1-4789-94b2-c2fd1fa62bf5 => generated 111 bytes in 193 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:09.317728 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:09.318237 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:09.324368 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.325219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.325658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.326362 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.326925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.327357 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.342508 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 HTTP/1.1 Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:37:09.344599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.346238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': '1ed76d3a-7638-4a6e-b229-054bd6f51d89'} Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:09.347132 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.349238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.351741 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:09.352894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c6461021-e39e-4483-94c2-5e4c5dbe2cc1 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 404 len: 111 microversion: 2.1 time: 0.039316 Sep 01 00:37:09.356958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 422/840] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:37:09 2022] DELETE /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:09.362514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:09.363300 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: 1ed76d3a-7638-4a6e-b229-054bd6f51d89] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:09.370017 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.370496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.370929 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.371621 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.372059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.372476 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.388997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 HTTP/1.1 Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:37:09.390658 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.397750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '1ed76d3a-7638-4a6e-b229-054bd6f51d89'} Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:09.398630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. Sep 01 00:37:09.399999 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:09.401553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance 1ed76d3a-7638-4a6e-b229-054bd6f51d89 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:09.401553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3e1b5ff7-495f-4e48-83e9-a8e4bae5166f tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89" status: 404 len: 111 microversion: 2.1 time: 0.033703 Sep 01 00:37:09.401553 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 419/841] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:09 2022] GET /compute/v2.1/servers/1ed76d3a-7638-4a6e-b229-054bd6f51d89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:09.792838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:09.794703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:09.802377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.802987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.803500 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:09.804289 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:09.804845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:09.805349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:10.041405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:10.050546 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6453e890-0721-4269-9787-82f406fc29b8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1318 microversion: 2.1 time: 0.262821 Sep 01 00:37:10.064522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 423/842] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:09 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:10.173036 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-b5ba086b-bebb-440e-9ff8-f7a601a294a3 req-64fa623a-a61e-4fc2-80b2-e9132c7489c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e65210a1-a630-46db-b595-aa5300ba011a", "tag": "76f30f7b-f9ac-4a1d-9b13-a2e69318d31b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:37:10.201851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b5ba086b-bebb-440e-9ff8-f7a601a294a3 req-64fa623a-a61e-4fc2-80b2-e9132c7489c4 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:10.202493 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b5ba086b-bebb-440e-9ff8-f7a601a294a3 req-64fa623a-a61e-4fc2-80b2-e9132c7489c4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:10.203515 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-b5ba086b-bebb-440e-9ff8-f7a601a294a3 req-64fa623a-a61e-4fc2-80b2-e9132c7489c4 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:10.214911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-b5ba086b-bebb-440e-9ff8-f7a601a294a3 req-64fa623a-a61e-4fc2-80b2-e9132c7489c4 service nova] Creating event network-changed:76f30f7b-f9ac-4a1d-9b13-a2e69318d31b for instance e65210a1-a630-46db-b595-aa5300ba011a on hv-cinder-82002 Sep 01 00:37:10.220258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-b5ba086b-bebb-440e-9ff8-f7a601a294a3 req-64fa623a-a61e-4fc2-80b2-e9132c7489c4 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053325 Sep 01 00:37:10.221154 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 420/843] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:37:10.573269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:10.574025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:10.580418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:10.580901 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:10.581340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:10.582279 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:10.582824 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:10.583257 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:10.600734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 HTTP/1.1 Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:37:10.603504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.605199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'd50b662a-3c38-40f3-92b5-37f693b80d25'} Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:10.606102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.607541 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.609184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:10.609184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2272bb27-f0d3-401b-b180-7640ab3cfb9e tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 404 len: 111 microversion: 2.1 time: 0.035933 Sep 01 00:37:10.609184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 424/844] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:37:10 2022] DELETE /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:10.615551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:10.616863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] [instance: d50b662a-3c38-40f3-92b5-37f693b80d25] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:10.623207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:10.623736 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:10.624191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:10.624964 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:10.625406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:10.625874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:10.640915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] HTTP exception thrown: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Request method failure captured: Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 HTTP/1.1 Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_1TGppP-KjIlspAfAS-kMrTrWXyOsMFpTcTESufcEcCXfJtiUn5YoQC-3n_ITk683JFWcNZvanVwCdj5MHHreaMpwHDCKtQaRf5mYyt02uTk_j8bF0TkaR7tmkMgHZE4VUbS5_OLBdkCJ3B_YsufGVdYrHpswRW4zcLRR2GJsSOxyg Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:37:10.642558 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_b1bcb33a579e47518fafa960505447dc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/b1bcb33a579e47518fafa960505447dc"}]}] Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: b1bcb33a579e47518fafa960505447dc Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1059779023 Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: e7a36e4630904f4eac08c9de1b8235ca Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-AttachVolumeNegativeTest-1059779023-project Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.643972 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'd50b662a-3c38-40f3-92b5-37f693b80d25'} Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:37:10.645937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. Sep 01 00:37:10.647400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:37:10.649019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] Returning 404 to user: Instance d50b662a-3c38-40f3-92b5-37f693b80d25 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:37:10.649019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3b0bd76e-1478-45d7-b434-66943063cd38 tempest-AttachVolumeNegativeTest-1059779023 tempest-AttachVolumeNegativeTest-1059779023-project] 10.222.0.25 "GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25" status: 404 len: 111 microversion: 2.1 time: 0.033237 Sep 01 00:37:10.649019 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 421/845] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:10 2022] GET /compute/v2.1/servers/d50b662a-3c38-40f3-92b5-37f693b80d25 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:37:11.073392 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:11.074261 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:11.080241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:11.080766 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:11.081206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:11.081895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:11.082391 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:11.082845 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:11.215477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:11.223435 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c91bd3a7-2904-4824-bccc-d07caff2b273 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1318 microversion: 2.1 time: 0.153749 Sep 01 00:37:11.223769 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 425/846] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:11 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:12.246178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:12.248070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:12.259998 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:12.261129 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:12.261821 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:12.263986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:12.265385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:12.266932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:12.303718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:12.429098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:12.437946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-055da066-7f18-409c-98d6-92e65689d9f5 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1318 microversion: 2.1 time: 0.196481 Sep 01 00:37:12.438839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 422/847] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:12 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:13.461007 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:13.461706 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:13.468366 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:13.468983 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:13.469480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:13.470351 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:13.470850 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:13.471273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:13.622373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:13.632364 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-72a5d7ca-ecf4-45ec-8b92-75273a58f76e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1318 microversion: 2.1 time: 0.175580 Sep 01 00:37:13.633204 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 426/848] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:13 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:14.269253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-633b4545-aa43-41ca-baa9-64a7f574bac6 req-026bb94f-c324-4067-ad85-b3f98e3c8f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65210a1-a630-46db-b595-aa5300ba011a", "name": "network-vif-plugged", "status": "completed", "tag": "76f30f7b-f9ac-4a1d-9b13-a2e69318d31b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:37:14.276610 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=68,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:14.280731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-633b4545-aa43-41ca-baa9-64a7f574bac6 req-026bb94f-c324-4067-ad85-b3f98e3c8f75 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:14.281400 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-633b4545-aa43-41ca-baa9-64a7f574bac6 req-026bb94f-c324-4067-ad85-b3f98e3c8f75 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:14.281827 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-633b4545-aa43-41ca-baa9-64a7f574bac6 req-026bb94f-c324-4067-ad85-b3f98e3c8f75 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:14.294351 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-633b4545-aa43-41ca-baa9-64a7f574bac6 req-026bb94f-c324-4067-ad85-b3f98e3c8f75 service nova] Creating event network-vif-plugged:76f30f7b-f9ac-4a1d-9b13-a2e69318d31b for instance e65210a1-a630-46db-b595-aa5300ba011a on hv-cinder-82002 Sep 01 00:37:14.299563 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-633b4545-aa43-41ca-baa9-64a7f574bac6 req-026bb94f-c324-4067-ad85-b3f98e3c8f75 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034642 Sep 01 00:37:14.300745 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 423/849] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:37:14.654574 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:14.655333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:14.662447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:14.662928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:14.663823 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:14.664726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:14.665303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:14.665734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:14.869642 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:14.880769 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c9d9031e-59af-466e-a551-f3188ac9529d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1318 microversion: 2.1 time: 0.230677 Sep 01 00:37:14.881470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 427/850] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:14 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1318 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:15.903160 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:15.903848 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:15.911499 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:15.911984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:15.912422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:15.913224 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:15.913675 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:15.914148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:16.057228 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:16.070032 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-144a5f06-b24e-416a-9f27-3c77ca3b0419 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1318 microversion: 2.1 time: 0.171101 Sep 01 00:37:16.070783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 424/851] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:15 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:17.092051 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:37:17.092742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:17.103303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:17.103798 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:17.104234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:17.104977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:17.105538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:17.105959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:17.271270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:37:17.281365 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ef46887d-c18f-424a-8f8b-e9cac32896d3 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1507 microversion: 2.1 time: 0.193590 Sep 01 00:37:17.282930 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 428/852] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:37:17 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:37:33.764639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0bff3e37-e645-478f-82b3-98867393cb5b", "device": "/dev/sdb"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:37:33.767521 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:37:33.770616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:33.771305 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:33.771947 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:33.772716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=10 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:37:33.779731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:33.780218 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:33.780683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:33.781386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:37:33.781838 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:37:33.782274 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:37:34.038722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-71ba4951-4a8c-4561-9157-5441c568007d tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "POST /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277224 Sep 01 00:37:34.039547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 425/853] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:37:33 2022] POST /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:38:07.166431 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:07.167233 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:07.170706 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:07.171716 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:07.172474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:07.182537 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:07.183041 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:07.183506 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:07.184236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:07.184726 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:07.185158 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:07.283051 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lazy-loading 'services' on Instance uuid e65210a1-a630-46db-b595-aa5300ba011a {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:38:07.357608 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6d013dff-3f91-44e7-9029-a59cf7260a04 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a/os-volume_attachments/0bff3e37-e645-478f-82b3-98867393cb5b" status: 202 len: 0 microversion: 2.1 time: 0.195176 Sep 01 00:38:07.358205 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 429/854] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:38:07 2022] DELETE /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a/os-volume_attachments/0bff3e37-e645-478f-82b3-98867393cb5b => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:38:08.496766 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:08.497533 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:08.501951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:08.502540 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:08.510276 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:08.510789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:08.511291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:08.512028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:08.512524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:08.512990 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:08.539942 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:38:08.622147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1e6a8d3b-98ec-4758-bafc-5aa6828d6f5e tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "DELETE /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 204 len: 0 microversion: 2.1 time: 0.126502 Sep 01 00:38:08.623092 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 426/855] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:38:08 2022] DELETE /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:38:08.632471 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:08.633446 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:08.639782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:08.640302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:08.640778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:08.641483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:08.641941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:08.642372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:08.780575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:08.789019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fa1c92a4-e8aa-485c-91bd-1a09b63b879b tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1513 microversion: 2.1 time: 0.161196 Sep 01 00:38:08.789588 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 430/856] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:08 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:09.810355 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:09.811042 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:09.817385 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:09.817863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:09.818293 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:09.819490 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:09.819933 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:09.820349 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:09.953405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:09.961784 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2a56c867-b4b2-48ce-afe2-ff0f2f418dea tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1513 microversion: 2.1 time: 0.155586 Sep 01 00:38:09.962340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 427/857] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:09 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:38:10.983019 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:10.983693 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:10.991046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:10.991547 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:10.991982 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:10.993009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:10.993470 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:10.993900 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:11.130657 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:11.138212 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e489ebd6-55f4-4d2d-855a-28b506f06a12 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1513 microversion: 2.1 time: 0.159859 Sep 01 00:38:11.138801 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 431/858] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:10 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:12.159301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:12.160034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:12.166603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:12.167140 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:12.167715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:12.168582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:12.169180 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:12.169823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:12.310292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:12.318037 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-528f8dfb-0bf4-422c-8a11-65cdb6f41007 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1513 microversion: 2.1 time: 0.162922 Sep 01 00:38:12.318598 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 428/859] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:12 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:13.343783 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:13.344605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:13.362423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:13.362923 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:13.363365 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:13.364175 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:13.364528 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:13.364954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:13.408954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-830cffc2-bcdc-46ee-9997-34d095326b75 req-3586a474-2d41-44d2-96f8-f2069679f7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e65210a1-a630-46db-b595-aa5300ba011a", "name": "network-vif-deleted", "tag": "76f30f7b-f9ac-4a1d-9b13-a2e69318d31b"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:38:13.428952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-830cffc2-bcdc-46ee-9997-34d095326b75 req-3586a474-2d41-44d2-96f8-f2069679f7b8 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:13.429825 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-830cffc2-bcdc-46ee-9997-34d095326b75 req-3586a474-2d41-44d2-96f8-f2069679f7b8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:13.430253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-830cffc2-bcdc-46ee-9997-34d095326b75 req-3586a474-2d41-44d2-96f8-f2069679f7b8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:13.448072 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-830cffc2-bcdc-46ee-9997-34d095326b75 req-3586a474-2d41-44d2-96f8-f2069679f7b8 service nova] Creating event network-vif-deleted:76f30f7b-f9ac-4a1d-9b13-a2e69318d31b for instance e65210a1-a630-46db-b595-aa5300ba011a on hv-cinder-82002 Sep 01 00:38:13.459443 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:13.461722 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-830cffc2-bcdc-46ee-9997-34d095326b75 req-3586a474-2d41-44d2-96f8-f2069679f7b8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056202 Sep 01 00:38:13.462622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 429/860] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:38:13.470640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8d181241-5130-410f-960f-00681cae6e30 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 200 len: 1471 microversion: 2.1 time: 0.133663 Sep 01 00:38:13.471222 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 432/861] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:13 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 1471 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:14.492275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:14.493110 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: e65210a1-a630-46db-b595-aa5300ba011a] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:14.499227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:14.499733 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:14.500150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:14.500906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:14.501422 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:14.501814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:14.515831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] HTTP exception thrown: Instance e65210a1-a630-46db-b595-aa5300ba011a could not be found. Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Request method failure captured: Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a HTTP/1.1 Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_6wyWLtpow4ws3VksFv7_O81zTqs2Gl-AEWeWkOjME7I-4UzI8M2tHjy4viijsEEsAoOCTjXdiMWG08d62uGSHenXpdkWyhqkrM7vzokjJUuE9vurYLKEnXOX0fGwpVhY0JJrC1CrKTgWVZE8DPC6OhsSh0Zlt5Ex1_Lb4r0LcHnpg Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 07af35e80c004621bd72ab7336930693 Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1284949098 Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:38:14.517496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07af35e80c004621bd72ab7336930693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07af35e80c004621bd72ab7336930693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07af35e80c004621bd72ab7336930693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07af35e80c004621bd72ab7336930693"}]}] Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotTestJSON-1284949098 Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 07af35e80c004621bd72ab7336930693 Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1284949098 Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotTestJSON-1284949098-project Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 7d042aa1a703464eab4a440db9ce1374 Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotTestJSON-1284949098-project Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance e65210a1-a630-46db-b595-aa5300ba011a could not be found. Sep 01 00:38:14.519223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'e65210a1-a630-46db-b595-aa5300ba011a'} Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e65210a1-a630-46db-b595-aa5300ba011a could not be found. Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:38:14.520062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e65210a1-a630-46db-b595-aa5300ba011a could not be found. Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e65210a1-a630-46db-b595-aa5300ba011a could not be found. Sep 01 00:38:14.521600 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:38:14.523925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Returning 404 to user: Instance e65210a1-a630-46db-b595-aa5300ba011a could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:38:14.523925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a240ed46-9315-4391-abfc-7709347f5234 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a" status: 404 len: 111 microversion: 2.1 time: 0.031477 Sep 01 00:38:14.523925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 430/862] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:14 2022] GET /compute/v2.1/servers/e65210a1-a630-46db-b595-aa5300ba011a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:38:23.423190 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-770479267", "imageRef": "7a697e78-5549-481a-b9a9-7c141312878b", "flavorRef": "452", "networks": [{"uuid": "7d63a16c-5384-4138-a6eb-6c8ecb267ec2"}]}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:38:23.434911 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=8 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:23.463593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:23.481998 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] validate_networks() for [('7d63a16c-5384-4138-a6eb-6c8ecb267ec2', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:38:23.925692 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:38:23.926114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:38:23.926620 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:38:23.927025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:38:23.927435 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:38:23.936711 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:23.937268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:23.937750 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:23.938609 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:23.939139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:23.939697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:23.957604 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Getting quotas for project 07af35e80c004621bd72ab7336930693. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:38:23.961566 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Getting quotas for user 7d042aa1a703464eab4a440db9ce1374 and project 07af35e80c004621bd72ab7336930693. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:38:23.972740 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:38:23.975018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7a697e78-5549-481a-b9a9-7c141312878b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:38:24.019085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [3f52b28a-3ab1-4446-8cea-a9b21cd321c8] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 00:38:25.027805 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO oslo.messaging._drivers.impl_rabbit [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [3f52b28a-3ab1-4446-8cea-a9b21cd321c8] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 58548. Sep 01 00:38:25.032092 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6924df55-659f-45b5-ab7a-872d9f3fcfa4 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.614225 Sep 01 00:38:25.032775 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 433/863] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:38:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:38:25.044366 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ce648411-386b-411d-92fe-93cfba943989 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:25.045715 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ce648411-386b-411d-92fe-93cfba943989 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:25.052060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:25.053004 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:25.110807 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ce648411-386b-411d-92fe-93cfba943989 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:25.118808 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ce648411-386b-411d-92fe-93cfba943989 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1218 microversion: 2.1 time: 0.078905 Sep 01 00:38:25.119188 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 431/864] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:25 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:26.139694 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:26.140414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:26.147452 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:26.148361 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:26.150231 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:26.151190 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:26.151847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:26.152528 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:26.242017 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:26.252667 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fa2c2afa-6a4a-4860-be85-57862c74f11a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1278 microversion: 2.1 time: 0.117314 Sep 01 00:38:26.268425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 434/865] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:26 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1278 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:27.275828 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:27.276668 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:27.284221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:27.284779 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:27.285311 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:27.286218 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:27.286665 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:27.287088 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:27.422360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:27.430783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-600e1ad7-078a-49a7-8c83-d21a5d736985 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.159552 Sep 01 00:38:27.431547 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 432/866] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:27 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:27.484416 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-af6f8be5-c31f-4307-869b-31646556d1a1 req-dacd4de4-6bf4-4a7a-b00a-e929c61c8d77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8a5292-8aab-4638-a254-a349e15987be", "tag": "e07edc79-f34b-44bf-95d0-9dc2c1ac3cfd"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:38:27.496590 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af6f8be5-c31f-4307-869b-31646556d1a1 req-dacd4de4-6bf4-4a7a-b00a-e929c61c8d77 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:27.497340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af6f8be5-c31f-4307-869b-31646556d1a1 req-dacd4de4-6bf4-4a7a-b00a-e929c61c8d77 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:27.498269 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-af6f8be5-c31f-4307-869b-31646556d1a1 req-dacd4de4-6bf4-4a7a-b00a-e929c61c8d77 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:27.510655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-af6f8be5-c31f-4307-869b-31646556d1a1 req-dacd4de4-6bf4-4a7a-b00a-e929c61c8d77 service nova] Creating event network-changed:e07edc79-f34b-44bf-95d0-9dc2c1ac3cfd for instance aa8a5292-8aab-4638-a254-a349e15987be on hv-cinder-82002 Sep 01 00:38:27.515722 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-af6f8be5-c31f-4307-869b-31646556d1a1 req-dacd4de4-6bf4-4a7a-b00a-e929c61c8d77 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035270 Sep 01 00:38:27.516318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 435/867] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:38:28.451993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:28.452755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:28.459968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:28.460726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:28.461041 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:28.461608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:28.462060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:28.462482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:28.603259 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:28.613163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-547a2b96-b1d6-4c99-a0e9-7b729e4362ed tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.165938 Sep 01 00:38:28.613799 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 433/868] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:28 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:29.634305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:29.635011 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:29.641684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:29.642172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:29.642609 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:29.643314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:29.643759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:29.644181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:29.782661 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:29.792660 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-16def336-67ab-46db-b6a1-a9ce5ef1770a tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.162627 Sep 01 00:38:29.793218 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 436/869] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:29 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:30.812950 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:30.813557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:30.820623 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:30.821103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:30.821531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:30.822468 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:30.822915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:30.823332 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:30.960345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:30.968359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-86643a75-9d5d-4a62-b12b-9745f8232069 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.159254 Sep 01 00:38:30.969070 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 434/870] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:30 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:31.988087 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:31.988731 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:31.995226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:31.995704 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:31.996139 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:31.996852 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:31.997305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:31.997731 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:32.127265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:32.134959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4f44d670-d38b-4377-b888-9d22f66a524f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.150719 Sep 01 00:38:32.135521 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 437/871] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:31 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:33.155661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:33.156265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:33.162759 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:33.163239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:33.163672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:33.164360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:33.164834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:33.165257 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:33.292523 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:33.300085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-8460636e-10da-4448-82eb-8ba985ce3067 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.148315 Sep 01 00:38:33.300672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 435/872] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:33 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:34.320579 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:34.321242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:34.324010 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:34.324782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:34.330921 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:34.331406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:34.331839 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:34.332569 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:34.333021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:34.333442 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:34.534894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:34.542945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b54bd8bd-8bde-4095-bfaa-3120f05ac554 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.226219 Sep 01 00:38:34.553060 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 438/873] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:34 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:35.563374 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:35.564137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:35.567632 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:35.574157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:35.574841 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:35.575270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:35.575963 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:35.576411 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:35.576898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:35.708572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:35.716970 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-60613f33-5ca5-4cb2-a24e-f1ac4b8e4475 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.157530 Sep 01 00:38:35.717537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 436/874] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:35 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:36.738077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:36.738784 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:36.746124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:36.746617 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:36.747068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:36.747761 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:36.748214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:36.748697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:36.889223 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:36.898333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0c7f2cd2-8e77-4db3-afa4-4c055d364b32 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.163410 Sep 01 00:38:36.899299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 439/875] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:36 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:37.737085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-1264ecf0-cad8-49b6-ac6e-09020cdb6fde req-dfb505c0-d8a7-4468-bbeb-983ba43a5150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8a5292-8aab-4638-a254-a349e15987be", "name": "network-vif-plugged", "status": "completed", "tag": "e07edc79-f34b-44bf-95d0-9dc2c1ac3cfd"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:38:37.748219 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1264ecf0-cad8-49b6-ac6e-09020cdb6fde req-dfb505c0-d8a7-4468-bbeb-983ba43a5150 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:37.748752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1264ecf0-cad8-49b6-ac6e-09020cdb6fde req-dfb505c0-d8a7-4468-bbeb-983ba43a5150 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:37.749171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-1264ecf0-cad8-49b6-ac6e-09020cdb6fde req-dfb505c0-d8a7-4468-bbeb-983ba43a5150 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:37.760279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-1264ecf0-cad8-49b6-ac6e-09020cdb6fde req-dfb505c0-d8a7-4468-bbeb-983ba43a5150 service nova] Creating event network-vif-plugged:e07edc79-f34b-44bf-95d0-9dc2c1ac3cfd for instance aa8a5292-8aab-4638-a254-a349e15987be on hv-cinder-82002 Sep 01 00:38:37.765196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-1264ecf0-cad8-49b6-ac6e-09020cdb6fde req-dfb505c0-d8a7-4468-bbeb-983ba43a5150 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031963 Sep 01 00:38:37.765783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 437/876] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:38:37.920207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:37.920803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:37.926713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:37.927194 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:37.927632 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:37.928328 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:37.928842 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:37.929264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:38.060765 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:38.068265 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-6c0f94c6-b0e5-4902-b2f2-4366f00ba781 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.152123 Sep 01 00:38:38.068862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 440/877] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:37 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:39.089930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:39.090630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:39.096762 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:39.097244 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:39.097679 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:39.098418 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:39.098850 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:39.099275 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:39.228957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:39.236690 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9cb4cd6a-c4a8-418a-afa4-d156124e7223 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1318 microversion: 2.1 time: 0.151324 Sep 01 00:38:39.237264 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 438/878] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:39 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:40.258921 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:40.259534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:40.266127 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:40.266642 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:40.267077 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:40.267779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:40.268232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:40.268703 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:40.406207 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:38:40.414503 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d3916d53-3132-41aa-8fcc-8ec3be5f71f8 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1507 microversion: 2.1 time: 0.160566 Sep 01 00:38:40.415084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 441/879] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:38:40 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:38:40.437353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cf341f4-9680-47b8-859c-14d202748185", "device": "/dev/sdb"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:38:40.439724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:40.446222 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:40.446960 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:40.447389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:40.448076 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:40.448543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:40.448963 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:40.684645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-cf6d7a1b-efd2-4ad4-9f3f-4451ddbdba77 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "POST /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251851 Sep 01 00:38:40.685282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 439/880] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:38:40 2022] POST /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:38:58.977114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:38:58.977601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:38:58.980267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:58.980990 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=46 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:38:58.986855 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:58.987338 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:58.987780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:58.988475 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:38:58.988972 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:38:58.989398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:38:59.068102 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lazy-loading 'services' on Instance uuid aa8a5292-8aab-4638-a254-a349e15987be {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:38:59.140862 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-70ecbb7a-cde5-498b-8eb4-f04d68caf7c7 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be/os-volume_attachments/5cf341f4-9680-47b8-859c-14d202748185" status: 202 len: 0 microversion: 2.1 time: 0.167390 Sep 01 00:38:59.141711 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 442/881] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:38:58 2022] DELETE /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be/os-volume_attachments/5cf341f4-9680-47b8-859c-14d202748185 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:39:00.264043 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=20 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:00.264927 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:00.269355 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:00.269946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:00.277386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:00.277868 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:00.278309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:00.279001 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:00.279456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:00.279884 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:00.306550 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:39:00.379566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-0253b80c-5a39-42bc-ac2a-728bd28a3684 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "DELETE /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 204 len: 0 microversion: 2.1 time: 0.117001 Sep 01 00:39:00.380155 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 440/882] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:39:00 2022] DELETE /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:39:00.390859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:00.391563 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:00.398322 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:00.399417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:00.399863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:00.400603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:00.401091 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:00.401520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:00.533260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:00.541103 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ea70e294-e0ec-462d-a09e-312eed772da0 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1513 microversion: 2.1 time: 0.154851 Sep 01 00:39:00.541666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 443/883] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:00 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:01.563153 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:01.563860 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:01.570823 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:01.571608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:01.572047 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:01.572801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:01.573256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:01.573682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:01.713197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:01.721214 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-4d142315-f0ca-41a4-8331-c8070d738ee9 tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1513 microversion: 2.1 time: 0.162628 Sep 01 00:39:01.721788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 441/884] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:01 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:02.744374 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:02.745153 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:02.765962 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:02.766736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:02.767287 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:02.768089 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:02.769409 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:02.770596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:02.825342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-6869edcf-f6e3-499c-8d43-a13a119a880a req-9ba3b996-2aa7-4a28-837b-aa11b66e5a90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8a5292-8aab-4638-a254-a349e15987be", "name": "network-vif-deleted", "tag": "e07edc79-f34b-44bf-95d0-9dc2c1ac3cfd"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:02.842659 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6869edcf-f6e3-499c-8d43-a13a119a880a req-9ba3b996-2aa7-4a28-837b-aa11b66e5a90 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:02.843171 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6869edcf-f6e3-499c-8d43-a13a119a880a req-9ba3b996-2aa7-4a28-837b-aa11b66e5a90 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:02.843578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-6869edcf-f6e3-499c-8d43-a13a119a880a req-9ba3b996-2aa7-4a28-837b-aa11b66e5a90 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:02.855345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-6869edcf-f6e3-499c-8d43-a13a119a880a req-9ba3b996-2aa7-4a28-837b-aa11b66e5a90 service nova] Creating event network-vif-deleted:e07edc79-f34b-44bf-95d0-9dc2c1ac3cfd for instance aa8a5292-8aab-4638-a254-a349e15987be on hv-cinder-82002 Sep 01 00:39:02.860832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-6869edcf-f6e3-499c-8d43-a13a119a880a req-9ba3b996-2aa7-4a28-837b-aa11b66e5a90 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046369 Sep 01 00:39:02.862060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 442/885] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:02.864791 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d042aa1a703464eab4a440db9ce1374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07af35e80c004621bd72ab7336930693', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:02.879828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4b19cb57-4e4b-413d-878b-0230851a540f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 200 len: 1471 microversion: 2.1 time: 0.141201 Sep 01 00:39:02.880556 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 444/886] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:02 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 1471 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:03.903285 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:03.903985 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] [instance: aa8a5292-8aab-4638-a254-a349e15987be] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:03.910250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:03.910734 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:03.911170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:03.911869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:03.912321 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:03.913294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:03.927046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] HTTP exception thrown: Instance aa8a5292-8aab-4638-a254-a349e15987be could not be found. Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Request method failure captured: Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be HTTP/1.1 Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_6wyWLtpow4ws3VksFv7_O81zTqs2Gl-AEWeWkOjME7I-4UzI8M2tHjy4viijsEEsAoOCTjXdiMWG08d62uGSHenXpdkWyhqkrM7vzokjJUuE9vurYLKEnXOX0fGwpVhY0JJrC1CrKTgWVZE8DPC6OhsSh0Zlt5Ex1_Lb4r0LcHnpg Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 07af35e80c004621bd72ab7336930693 Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1284949098 Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:39:03.929481 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_07af35e80c004621bd72ab7336930693"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/07af35e80c004621bd72ab7336930693"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07af35e80c004621bd72ab7336930693"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/07af35e80c004621bd72ab7336930693"}]}] Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-VolumesSnapshotTestJSON-1284949098 Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 07af35e80c004621bd72ab7336930693 Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1284949098 Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-VolumesSnapshotTestJSON-1284949098-project Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 7d042aa1a703464eab4a440db9ce1374 Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-VolumesSnapshotTestJSON-1284949098-project Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance aa8a5292-8aab-4638-a254-a349e15987be could not be found. Sep 01 00:39:03.931239 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'aa8a5292-8aab-4638-a254-a349e15987be'} Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8a5292-8aab-4638-a254-a349e15987be could not be found. Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:39:03.932121 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8a5292-8aab-4638-a254-a349e15987be could not be found. Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8a5292-8aab-4638-a254-a349e15987be could not be found. Sep 01 00:39:03.933603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:39:03.934783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] Returning 404 to user: Instance aa8a5292-8aab-4638-a254-a349e15987be could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:39:03.934783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-834b6eef-9a2f-44fe-a247-6df8b1189d8f tempest-VolumesSnapshotTestJSON-1284949098 tempest-VolumesSnapshotTestJSON-1284949098-project] 10.222.0.25 "GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be" status: 404 len: 111 microversion: 2.1 time: 0.032990 Sep 01 00:39:03.934783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 443/887] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:03 2022] GET /compute/v2.1/servers/aa8a5292-8aab-4638-a254-a349e15987be => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:39:23.362893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-670dc54c-668f-49c1-985e-166c9a2404c7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Action: 'create', calling method: .version_select at 0x7fcadfdeed30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-196989010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFsNAJyvc6p6SqomR1hdOf9tdsJh5jWBT7sT9/ssVQV76jKtnY0Zg2v33lZZJy41l8NlJEmCjIAqkgV6nbqmFmrMgO44ZVM7YKG9cFTPw2ilsK0x/ZkAiOo4T9wUGwLOg=="}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:23.368734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:23.369597 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:23.382373 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-670dc54c-668f-49c1-985e-166c9a2404c7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Getting quotas for project a22a4b4aab87497eb1f8b1bce8cd17d5. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:39:23.386118 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-670dc54c-668f-49c1-985e-166c9a2404c7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Getting quotas for user d7396c3776b744328babae60d6cfb6fd and project a22a4b4aab87497eb1f8b1bce8cd17d5. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:39:23.398201 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR oslo.messaging._drivers.impl_rabbit [None req-670dc54c-668f-49c1-985e-166c9a2404c7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [324de663-9af1-4493-b544-d8bd35c7805f] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 00:39:24.407655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO oslo.messaging._drivers.impl_rabbit [None req-670dc54c-668f-49c1-985e-166c9a2404c7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [324de663-9af1-4493-b544-d8bd35c7805f] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59300. Sep 01 00:39:24.422119 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-670dc54c-668f-49c1-985e-166c9a2404c7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 1.063294 Sep 01 00:39:24.422710 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 445/888] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:39:23 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:24.476855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-578625769", "imageRef": "6ada3f24-cca3-4613-8ef3-272f8dd976a9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-196989010", "networks": [{"uuid": "081f6276-ed6d-45db-bc80-ea1c979d3909"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:24.485370 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:24.486015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:24.532899 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] validate_networks() for [('081f6276-ed6d-45db-bc80-ea1c979d3909', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:39:24.919897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:39:24.920321 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:39:24.920863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:39:24.921272 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:39:24.921734 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:39:24.931115 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:24.931594 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:24.932029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:24.932782 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:24.933250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:24.933674 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:24.952427 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Getting quotas for project a22a4b4aab87497eb1f8b1bce8cd17d5. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:39:24.956368 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Getting quotas for user d7396c3776b744328babae60d6cfb6fd and project a22a4b4aab87497eb1f8b1bce8cd17d5. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:39:24.967582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:39:24.969955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6ada3f24-cca3-4613-8ef3-272f8dd976a9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:39:25.015030 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [11251d1b-0bba-47e4-a265-de42edfd54d7] AMQP server on 10.222.0.25:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 01 00:39:26.022161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [11251d1b-0bba-47e4-a265-de42edfd54d7] Reconnected to AMQP server on 10.222.0.25:5672 via [amqp] client with port 59338. Sep 01 00:39:26.026353 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fbea37f9-03b4-4e36-b270-94987d446613 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.553553 Sep 01 00:39:26.027091 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 444/889] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:39:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:39:26.038488 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-17428eee-646e-4bc5-b52d-248889b686a2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:26.039848 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-17428eee-646e-4bc5-b52d-248889b686a2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:26.106134 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-17428eee-646e-4bc5-b52d-248889b686a2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:26.115183 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-17428eee-646e-4bc5-b52d-248889b686a2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1257 microversion: 2.1 time: 0.080782 Sep 01 00:39:26.116796 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 446/890] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:26 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1257 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:27.137709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:27.138320 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:27.145597 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:27.145837 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:27.146954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:27.147682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:27.148170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:27.148640 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:27.210524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:27.218230 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2b4dd9f2-05f4-4fe6-967f-8dca1e1e9544 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1261 microversion: 2.1 time: 0.084741 Sep 01 00:39:27.218982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 445/891] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:27 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1261 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:28.238505 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:28.239128 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:28.259999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:28.260418 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:28.260892 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:28.261611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:28.262075 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:28.262503 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:28.370295 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:28.381502 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2771d13d-1aa7-40ce-a8f6-558e38c885de tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1327 microversion: 2.1 time: 0.145897 Sep 01 00:39:28.382300 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 447/892] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:28 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1327 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:29.407898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:29.408611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:29.424902 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:29.428285 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:29.431152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:29.432137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:29.432803 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:29.434841 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:29.684890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:29.695208 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-f191e58c-2ba7-4e3d-a70d-375074cda915 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.295919 Sep 01 00:39:29.709161 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 446/893] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:29 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:30.719548 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:30.720925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:30.730994 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:30.740686 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:30.741525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:30.743291 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:30.743993 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:30.745187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:31.366849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:31.377717 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d352fa93-8459-4b7a-8728-aa5aab35b1cd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.662177 Sep 01 00:39:31.381868 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 448/894] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:30 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:32.403431 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:32.404034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:32.429912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:32.430775 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:32.431394 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:32.432308 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:32.432941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:32.433539 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:32.705179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:32.715397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6a0d73da-4ea2-4799-8732-e8f7730a97db tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.315508 Sep 01 00:39:32.716096 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 447/895] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:32 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:33.742138 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:33.743512 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:33.757242 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:33.758104 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:33.758821 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:33.765840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:33.766701 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:33.767358 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:34.247066 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:34.271735 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-361e5fc5-9c12-44e7-a5ee-83176d69bf8a tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.534591 Sep 01 00:39:34.272390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 449/896] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:33 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:34.940451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-66547f5e-ac95-4520-9b20-3786dd2db808 req-8ccb9433-f8c2-4ad2-b4dd-731ffc23bed2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:34.948485 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:34.963330 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:34.972302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-66547f5e-ac95-4520-9b20-3786dd2db808 req-8ccb9433-f8c2-4ad2-b4dd-731ffc23bed2 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:34.973261 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-66547f5e-ac95-4520-9b20-3786dd2db808 req-8ccb9433-f8c2-4ad2-b4dd-731ffc23bed2 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:34.974752 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-66547f5e-ac95-4520-9b20-3786dd2db808 req-8ccb9433-f8c2-4ad2-b4dd-731ffc23bed2 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:34.992482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-66547f5e-ac95-4520-9b20-3786dd2db808 req-8ccb9433-f8c2-4ad2-b4dd-731ffc23bed2 service nova] Creating event network-changed:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:39:35.000398 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-66547f5e-ac95-4520-9b20-3786dd2db808 req-8ccb9433-f8c2-4ad2-b4dd-731ffc23bed2 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065787 Sep 01 00:39:35.001423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 448/897] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:39:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:35.295473 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:35.296167 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:35.309313 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:35.314722 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:35.315261 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:35.316033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:35.316517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:35.325270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:35.793933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:35.805556 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0cf202b2-ad28-40fa-95af-fe40d0f0751b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.513974 Sep 01 00:39:35.808667 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 450/898] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:35 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:36.834344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:36.834344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:36.842306 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:36.849562 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:36.850163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:36.853098 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:36.853851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:36.854709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:37.089891 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:37.098268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5f0353bd-5a9e-421f-bad4-c4bb2366581b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.274780 Sep 01 00:39:37.099964 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 449/899] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:36 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:38.119570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:38.120181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:38.125662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:38.127662 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:38.128460 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:38.129000 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:38.130306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:38.130889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:38.131540 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:38.468393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:38.487793 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-f020f989-6881-46e5-bf47-1f6eea09f1c9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.372078 Sep 01 00:39:38.488405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 451/900] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:38 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:39.513880 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:39.515223 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:39.529168 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:39.529980 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:39.530432 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:39.531155 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:39.531611 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:39.532221 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:39.698167 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:39.708162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5364c785-4daf-4b65-a221-65845e6aad49 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.198134 Sep 01 00:39:39.709987 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 450/901] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:39 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:40.730585 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:40.731520 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:40.738640 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:40.739933 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:40.740682 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:40.741655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:40.742219 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:40.742883 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:40.939429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:40.955540 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b675476d-22d5-4437-b557-e0882c95eb26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.228675 Sep 01 00:39:40.956785 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 452/902] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:40 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:41.978560 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:41.979183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:41.985251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:41.986657 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:41.987093 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:41.987801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:41.988251 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:41.988704 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:42.145283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:42.154198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-720bb5e8-a82c-4912-bcab-4f148b050d45 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.180605 Sep 01 00:39:42.154626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 451/903] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:41 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:42.308040 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e31e7def-6cb6-40a5-adfe-c5cec82b4168 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Action: 'create', calling method: .version_select at 0x7fcadfc62c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-2019141328", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf62V5WEWOtdoM+nFbqC1AiXHuUJNDTqdaVP+7HGvN0xAMymoZorUpeuAwrEhZZejLdJjpMvmPw4fhpALUiIhtVLJ6a0qj4SfMId2cTXty4ICZA0UAvfozLvOLNlZ4LWQ=="}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:42.323045 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-e31e7def-6cb6-40a5-adfe-c5cec82b4168 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for project 31e9903e4f16471d8057ee7364cf123b. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:39:42.326690 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-e31e7def-6cb6-40a5-adfe-c5cec82b4168 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for user 048aba7c5b364b07abf7f6b8977d167a and project 31e9903e4f16471d8057ee7364cf123b. Resources: {'key_pairs'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:39:42.350277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e31e7def-6cb6-40a5-adfe-c5cec82b4168 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.283132 Sep 01 00:39:42.350871 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 453/904] 10.222.0.25 () {60 vars in 1159 bytes} [Thu Sep 1 00:39:42 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:39:43.178062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:43.178788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:43.185994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:43.186633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:43.187197 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:43.188184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:43.188925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:43.189447 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:43.338497 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:43.347031 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-08dbaa6f-4e88-458e-96af-5acaf92e4bd2 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.173978 Sep 01 00:39:43.351199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 452/905] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:43 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:44.370213 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:44.371916 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:44.379404 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:44.380023 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:44.380455 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:44.381198 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:44.381649 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:44.382073 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:44.633523 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:44.641325 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0cc66491-a214-4545-8da4-4524194f8b75 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.277397 Sep 01 00:39:44.641893 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 454/906] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:44 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:45.056900 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-35a6eb22-c6b6-49be-aa04-7dd4758bdf34 req-a9741131-ce3a-4c97-af3f-917ea0920c17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "name": "network-vif-plugged", "status": "completed", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:45.069295 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-35a6eb22-c6b6-49be-aa04-7dd4758bdf34 req-a9741131-ce3a-4c97-af3f-917ea0920c17 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:45.069840 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-35a6eb22-c6b6-49be-aa04-7dd4758bdf34 req-a9741131-ce3a-4c97-af3f-917ea0920c17 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:45.070788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-35a6eb22-c6b6-49be-aa04-7dd4758bdf34 req-a9741131-ce3a-4c97-af3f-917ea0920c17 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:45.085317 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-35a6eb22-c6b6-49be-aa04-7dd4758bdf34 req-a9741131-ce3a-4c97-af3f-917ea0920c17 service nova] Creating event network-vif-plugged:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:39:45.090585 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-35a6eb22-c6b6-49be-aa04-7dd4758bdf34 req-a9741131-ce3a-4c97-af3f-917ea0920c17 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038091 Sep 01 00:39:45.091453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 453/907] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:39:45.662781 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:45.663439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:45.671187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:45.671847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:45.672677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:45.673443 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:45.673899 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:45.674323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:45.817377 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:45.826004 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e274c9f4-4c2b-47fa-ac36-dec5daa5a664 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1357 microversion: 2.1 time: 0.167698 Sep 01 00:39:45.826666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 455/908] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:45 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:46.849604 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:46.850969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:46.857778 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:46.858258 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:46.858962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:46.859726 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:46.860386 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:46.860835 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.064480 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:47.072610 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-1667f781-b4a4-48d7-920b-e7137f3fc63d tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1548 microversion: 2.1 time: 0.227668 Sep 01 00:39:47.073159 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 454/909] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:46 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1548 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:47.093290 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:47.094081 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:47.102794 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:47.103285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:47.103719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.104424 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:47.104896 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:47.105316 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.242088 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:47.250359 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-52b112d8-55d8-4030-ba85-6990a7c7a622 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1548 microversion: 2.1 time: 0.160882 Sep 01 00:39:47.251024 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 456/910] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:47 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1548 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:47.270557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:47.275291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:47.276039 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Searching by: {'deleted': False, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5'} {{(pid=132498) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 01 00:39:47.283156 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:47.283639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:47.284068 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.284830 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:47.285278 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:47.285697 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.376191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.multi_cell_list [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=132498) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 01 00:39:47.477184 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-78c97ae7-3403-4358-bfa8-6024ccb5ad26 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.210357 Sep 01 00:39:47.477769 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 455/911] 10.222.0.25 () {58 vars in 1125 bytes} [Thu Sep 1 00:39:47 2022] GET /compute/v2.1/servers => generated 342 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:47.492867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:47.493499 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:47.499430 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:47.499918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:47.500359 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.501083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:47.501540 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:47.501967 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:47.635894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:47.643678 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-602fdeba-9441-45a2-9aa8-42ba2403e185 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1548 microversion: 2.1 time: 0.155788 Sep 01 00:39:47.644241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 457/912] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:47 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:49.194904 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a69698bb-3605-462f-a097-907a879ae645"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:49.197510 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:49.203832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:49.204310 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:49.204773 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:49.205555 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:49.206006 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:49.206428 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:49.453748 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-64a7df9e-bdc6-4397-abf5-a2cb39446135 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263381 Sep 01 00:39:49.454643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 456/913] 10.222.0.25 () {60 vars in 1323 bytes} [Thu Sep 1 00:39:49 2022] POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:56.010199 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:56.010748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:56.013314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=4 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:56.014085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:56.020097 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:56.020611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:56.021053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:56.021752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:56.022204 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:56.022628 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:56.026572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=61 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:56.151050 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:56.159253 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3d34c47c-0a25-45ac-b93b-f57e3be875d5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1594 microversion: 2.1 time: 0.153619 Sep 01 00:39:56.159803 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 458/914] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:56 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:39:57.846783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-299f58cd-e765-435d-b45b-c3ec07ec40f3 req-c9438aba-6e5f-405d-8452-bd2009cfc2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:57.859986 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:57.860813 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:57.868403 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-299f58cd-e765-435d-b45b-c3ec07ec40f3 req-c9438aba-6e5f-405d-8452-bd2009cfc2f7 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:57.868911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-299f58cd-e765-435d-b45b-c3ec07ec40f3 req-c9438aba-6e5f-405d-8452-bd2009cfc2f7 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:57.869345 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-299f58cd-e765-435d-b45b-c3ec07ec40f3 req-c9438aba-6e5f-405d-8452-bd2009cfc2f7 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:57.874096 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:39:57.882721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-299f58cd-e765-435d-b45b-c3ec07ec40f3 req-c9438aba-6e5f-405d-8452-bd2009cfc2f7 service nova] Creating event network-changed:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:39:57.888352 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-299f58cd-e765-435d-b45b-c3ec07ec40f3 req-c9438aba-6e5f-405d-8452-bd2009cfc2f7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045583 Sep 01 00:39:57.889177 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 457/915] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:58.690343 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1545094377", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2019141328", "security_groups": [{"name": "tempest-secgroup-smoke-1194673048"}], "block_device_mapping_v2": [{"uuid": "d1a159b9-df3f-42f4-be49-257192d2bbab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28512075-6511-4bf7-8914-a7d1b95a8073"}]}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:58.822336 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] validate_networks() for [('28512075-6511-4bf7-8914-a7d1b95a8073', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:39:58.893282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-572808130"}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:58.893982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:58.906951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:58.907731 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:58.908340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:58.909088 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:58.909537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:58.910133 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:59.056702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.network.security_group_api [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Adding security group ab36321a-82c7-4ded-ab7b-7bda646e7f41 to port ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f Sep 01 00:39:59.231112 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:39:59.232326 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:39:59.233122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:39:59.233727 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:39:59.235299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:39:59.248339 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:59.250277 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:59.251045 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:59.252464 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:59.253342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:59.254163 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:59.271758 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for project 31e9903e4f16471d8057ee7364cf123b. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:39:59.276279 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for user 048aba7c5b364b07abf7f6b8977d167a and project 31e9903e4f16471d8057ee7364cf123b. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:39:59.333806 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:39:59.335996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1a159b9-df3f-42f4-be49-257192d2bbab',volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:39:59.399292 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5fbb8dc7-819c-4618-a43d-da4f0e2a5b31 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.518323 Sep 01 00:39:59.401954 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 458/916] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:39:58 2022] POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:39:59.407375 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-c09687dc-c95d-4b96-8b4f-2aaf06b536b4 req-08522125-cbfa-45ec-b9d1-4c60b8aba46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:39:59.419163 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c09687dc-c95d-4b96-8b4f-2aaf06b536b4 req-08522125-cbfa-45ec-b9d1-4c60b8aba46b service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:59.420315 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c09687dc-c95d-4b96-8b4f-2aaf06b536b4 req-08522125-cbfa-45ec-b9d1-4c60b8aba46b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:59.420791 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-c09687dc-c95d-4b96-8b4f-2aaf06b536b4 req-08522125-cbfa-45ec-b9d1-4c60b8aba46b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:59.445898 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-c09687dc-c95d-4b96-8b4f-2aaf06b536b4 req-08522125-cbfa-45ec-b9d1-4c60b8aba46b service nova] Creating event network-changed:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:39:59.462309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-c09687dc-c95d-4b96-8b4f-2aaf06b536b4 req-08522125-cbfa-45ec-b9d1-4c60b8aba46b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057389 Sep 01 00:39:59.462957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 459/917] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:39:59.474029 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:59.475022 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:59.484793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:59.485284 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:59.485939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:59.486871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:39:59.487409 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:39:59.488020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:39:59.514886 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-221ae675-293b-4487-8984-23519c003899 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828303 Sep 01 00:39:59.516172 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 459/918] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:39:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:39:59.526509 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9154d27f-fb9e-4b84-ba31-4172a085bafa tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:39:59.527393 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9154d27f-fb9e-4b84-ba31-4172a085bafa tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:39:59.618753 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-9154d27f-fb9e-4b84-ba31-4172a085bafa tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:59.626259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9154d27f-fb9e-4b84-ba31-4172a085bafa tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1095 microversion: 2.1 time: 0.103646 Sep 01 00:39:59.626842 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 460/919] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:59 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1095 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:39:59.663603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:39:59.676833 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ebef4503-c27f-4f23-bccf-078b590a2ce7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1759 microversion: 2.1 time: 0.212153 Sep 01 00:39:59.677586 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 460/920] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:39:59 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1759 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:00.645999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:00.646626 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:00.653671 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:00.654152 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:00.654585 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:00.655283 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:00.656149 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:00.656149 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:00.740905 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:00.749912 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d2d993f6-cab5-474f-a2d4-6a811c37bd5f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1193 microversion: 2.1 time: 0.107909 Sep 01 00:40:00.751210 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 461/921] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:00 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1193 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:01.771178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:01.771779 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:01.778721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:01.779256 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:01.779694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:01.780391 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:01.780868 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:01.781301 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:01.922147 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:01.930338 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-57d3e6cd-f42c-4582-b773-5034a1ca2af8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.162528 Sep 01 00:40:01.930912 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 461/922] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:01 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:02.056959 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-fbf96f2a-5bf8-4e2a-9727-506f5285fe94 req-9c7b8b97-2186-4d49-a5aa-b30927be5c4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c472673e-4179-483d-a44f-d9a4fe49b434", "tag": "d3208c8e-df8b-4d14-9287-98e93f1ba938"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:40:02.066997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-fbf96f2a-5bf8-4e2a-9727-506f5285fe94 req-9c7b8b97-2186-4d49-a5aa-b30927be5c4a service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:02.067474 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-fbf96f2a-5bf8-4e2a-9727-506f5285fe94 req-9c7b8b97-2186-4d49-a5aa-b30927be5c4a service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:02.067999 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-fbf96f2a-5bf8-4e2a-9727-506f5285fe94 req-9c7b8b97-2186-4d49-a5aa-b30927be5c4a service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:02.080206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-fbf96f2a-5bf8-4e2a-9727-506f5285fe94 req-9c7b8b97-2186-4d49-a5aa-b30927be5c4a service nova] Creating event network-changed:d3208c8e-df8b-4d14-9287-98e93f1ba938 for instance c472673e-4179-483d-a44f-d9a4fe49b434 on hv-cinder-82002 Sep 01 00:40:02.085255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-fbf96f2a-5bf8-4e2a-9727-506f5285fe94 req-9c7b8b97-2186-4d49-a5aa-b30927be5c4a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034286 Sep 01 00:40:02.086135 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 462/923] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:40:02.950669 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:02.951277 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:02.957564 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:02.958046 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:02.958482 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:02.959307 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:02.959790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:02.960215 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:03.092373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:03.099921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-249fc13c-da5c-449c-ba08-c6336e490b8d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.153085 Sep 01 00:40:03.100486 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 462/924] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:02 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:04.121674 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:04.122409 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:04.128986 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:04.129472 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:04.129909 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:04.130601 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:04.131055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:04.131483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:04.266109 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:04.274356 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-3940ba45-1cdc-4dd9-94c6-2474a0649084 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.157698 Sep 01 00:40:04.274916 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 463/925] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:04 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:05.294374 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:05.294985 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:05.297760 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 00:40:05.297905 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Thu Sep 1 00:40:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 (ip 10.222.0.25) !!! Sep 01 00:40:05.304683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:05.305175 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:05.305608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:05.306298 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:05.306749 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:05.307172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:05.438238 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:05.446856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-feea8032-9445-438d-9b79-be0994b8e93e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.156287 Sep 01 00:40:05.447413 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 463/926] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:05 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:06.467307 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:06.467945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:06.474489 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:06.474967 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:06.475405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:06.476094 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:06.476596 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:06.476996 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:06.608477 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:06.616187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fc4e4dc9-7d27-48bb-90a5-033bc72c9a81 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.152783 Sep 01 00:40:06.617674 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 464/927] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:06 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:07.637750 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:07.638373 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:07.644890 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:07.645378 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:07.645814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:07.646507 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:07.646992 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:07.647416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:07.786359 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:07.795855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-63b998c7-c206-4022-966e-e0ba0f5e84dd tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.161963 Sep 01 00:40:07.796419 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 464/928] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:07 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:08.816532 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:08.817143 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:08.823981 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:08.824517 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:08.824969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:08.825670 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:08.826125 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:08.826552 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:08.954644 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:08.962211 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0c57235c-bb5d-4e65-be97-6b88415b726a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.149744 Sep 01 00:40:08.962769 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 465/929] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:08 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:09.982470 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:09.983082 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:09.989639 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:09.990122 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:09.990557 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:09.991241 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:09.992227 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:09.992770 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:10.128937 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:10.137271 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-56abe24e-90b1-47da-a763-83fecd8dd924 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.158632 Sep 01 00:40:10.137839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 465/930] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:09 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:11.157939 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:11.158681 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:11.161609 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:11.162285 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=8 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:11.168349 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:11.168876 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:11.169314 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:11.170013 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:11.170463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:11.170889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:11.302854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:11.311384 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-444c2a92-d40d-4c0c-abd0-939241f4add0 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.157545 Sep 01 00:40:11.311946 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 466/931] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:11 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:12.332025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:12.332673 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:12.339253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:12.339728 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:12.340157 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:12.340942 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:12.341389 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:12.341805 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:12.474659 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:12.482516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3b232448-851a-4b97-b987-753c1e423a2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.154280 Sep 01 00:40:12.483084 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 466/932] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:12 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:13.096990 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-5182d12c-74ec-4b00-9184-d085395a1f47 req-d3c6fdd9-b5ad-4318-8ed4-a35103571910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c472673e-4179-483d-a44f-d9a4fe49b434", "name": "network-vif-plugged", "status": "completed", "tag": "d3208c8e-df8b-4d14-9287-98e93f1ba938"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:40:13.107398 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-5182d12c-74ec-4b00-9184-d085395a1f47 req-d3c6fdd9-b5ad-4318-8ed4-a35103571910 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:13.107871 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-5182d12c-74ec-4b00-9184-d085395a1f47 req-d3c6fdd9-b5ad-4318-8ed4-a35103571910 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:13.108294 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-5182d12c-74ec-4b00-9184-d085395a1f47 req-d3c6fdd9-b5ad-4318-8ed4-a35103571910 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:13.119969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-5182d12c-74ec-4b00-9184-d085395a1f47 req-d3c6fdd9-b5ad-4318-8ed4-a35103571910 service nova] Creating event network-vif-plugged:d3208c8e-df8b-4d14-9287-98e93f1ba938 for instance c472673e-4179-483d-a44f-d9a4fe49b434 on hv-cinder-82002 Sep 01 00:40:13.124969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-5182d12c-74ec-4b00-9184-d085395a1f47 req-d3c6fdd9-b5ad-4318-8ed4-a35103571910 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Sep 01 00:40:13.125559 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 467/933] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:40:13.503072 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:13.503674 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:13.510561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:13.511034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:13.511462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:13.512140 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:13.512622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:13.513040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:13.640976 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:13.648488 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-60949e20-0466-42e0-bd1a-bf76cca280bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.149232 Sep 01 00:40:13.649100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 467/934] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:13 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:14.670282 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:14.671012 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:14.677108 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:14.677587 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:14.678024 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:14.678713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:14.679167 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:14.679593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:14.810467 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:14.818612 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-eb858319-79c6-4cb7-bfbd-6ee6d16662b5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1267 microversion: 2.1 time: 0.153441 Sep 01 00:40:14.819189 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 468/935] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:14 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:15.839064 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:15.839666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:15.846328 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:15.846801 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:15.847231 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:15.847915 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:15.848360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:15.848814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:15.984951 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:15.992437 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-277b36d2-e7df-4d1f-8830-c8a4f8c06549 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1455 microversion: 2.1 time: 0.157377 Sep 01 00:40:15.993026 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 468/936] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:15 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1455 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:16.012721 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:16.013335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:16.019637 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:16.020122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:16.020598 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:16.021295 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:16.021748 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:16.022177 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:16.154513 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:16.162315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1100ab1d-4517-4db5-87eb-891daa25fb1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1455 microversion: 2.1 time: 0.154133 Sep 01 00:40:16.162879 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 469/937] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:16 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1455 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:18.066178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-7ea25d9c-0c4a-4360-beed-f3d01c3770ff req-5eddf8f1-bb63-468b-837d-6522a50cdab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c472673e-4179-483d-a44f-d9a4fe49b434", "tag": "d3208c8e-df8b-4d14-9287-98e93f1ba938"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:40:18.076959 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7ea25d9c-0c4a-4360-beed-f3d01c3770ff req-5eddf8f1-bb63-468b-837d-6522a50cdab7 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:18.077430 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7ea25d9c-0c4a-4360-beed-f3d01c3770ff req-5eddf8f1-bb63-468b-837d-6522a50cdab7 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:18.077858 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-7ea25d9c-0c4a-4360-beed-f3d01c3770ff req-5eddf8f1-bb63-468b-837d-6522a50cdab7 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:18.088636 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-7ea25d9c-0c4a-4360-beed-f3d01c3770ff req-5eddf8f1-bb63-468b-837d-6522a50cdab7 service nova] Creating event network-changed:d3208c8e-df8b-4d14-9287-98e93f1ba938 for instance c472673e-4179-483d-a44f-d9a4fe49b434 on hv-cinder-82002 Sep 01 00:40:18.093869 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-7ea25d9c-0c4a-4360-beed-f3d01c3770ff req-5eddf8f1-bb63-468b-837d-6522a50cdab7 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031307 Sep 01 00:40:18.094834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 469/938] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:40:25.331309 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:40:25.333629 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:25.340768 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:25.341253 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:25.341694 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:25.342385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:25.342838 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:25.343261 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:25.418951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2c1be188-a228-4c0f-b946-ac3ed7534ec5 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.091298 Sep 01 00:40:25.419731 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 470/939] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:40:25 2022] POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:40:25.428735 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:25.429479 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:25.437343 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:25.437832 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:25.438316 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:25.439103 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:25.439543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:25.439971 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:25.585291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:25.594086 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3ee7e052-e270-4965-9b00-1ea2f3d943c8 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1751 microversion: 2.1 time: 0.169999 Sep 01 00:40:25.594655 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 470/940] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:25 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:26.617246 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:26.617941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:26.619856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:26.625382 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:26.625861 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:26.626292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:26.626978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:26.627424 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:26.627847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:26.631142 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:26.773566 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:26.781903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bf31db23-7255-46ed-8dc4-fbfbe3f7aae1 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.169431 Sep 01 00:40:26.782466 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 471/941] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:26 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:27.802331 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:27.802942 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:27.809492 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:27.809969 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:27.810397 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:27.811087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:27.811531 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:27.811952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:27.957530 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:27.966193 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c285216e-6363-419d-a6da-7eea2e0e47d9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.167778 Sep 01 00:40:27.966755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 471/942] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:27 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:28.987164 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:28.987684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:28.994086 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:28.994566 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:28.995497 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:28.996180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:28.996661 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:28.997083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:29.142988 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:29.151110 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-4f6ef691-9146-4fec-b945-1e0948a07a74 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.167866 Sep 01 00:40:29.152178 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 472/943] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:28 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:30.173383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:30.173984 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:30.176350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=30 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:30.181521 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:30.181993 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:30.182423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:30.183132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:30.183582 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:30.183994 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:30.187982 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=76 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:40:30.324467 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:30.332674 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-627677b7-6e1f-454e-917f-e73cad84d627 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.163168 Sep 01 00:40:30.333248 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 472/944] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:30 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:31.355918 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:31.356538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:31.363146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:31.363623 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:31.364053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:31.364774 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:31.365222 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:31.365638 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:31.504870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:31.518577 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-b8433b8a-1739-453f-93ec-777ed58e98c3 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.167111 Sep 01 00:40:31.519341 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 473/945] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:31 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:32.539537 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:32.540151 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:32.547423 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:32.547908 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:32.548342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:32.549078 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:32.549536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:32.549960 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:32.694516 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:32.702897 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-c1c3c370-40d6-4873-abc3-b9d45ca5278b tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.167210 Sep 01 00:40:32.703454 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 473/946] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:32 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:33.724267 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:33.724919 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:33.731773 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:33.732251 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:33.732797 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:33.733719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:33.734273 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:33.734763 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:33.877423 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:33.885573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a0766398-19b1-4c99-83e8-ebc1b1687bda tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.165143 Sep 01 00:40:33.886129 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 474/947] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:33 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:34.907186 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:34.907804 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:34.914210 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:34.914689 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:34.915123 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:34.915814 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:34.916266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:34.916730 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:35.064618 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:35.073020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9282e6be-2704-4262-ba90-a96cb17225a9 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.169793 Sep 01 00:40:35.073573 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 474/948] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:34 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:36.094715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:36.095323 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:36.101778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:36.102263 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:36.102696 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:36.103372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:36.103821 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:36.104236 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:36.247736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:36.255951 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-954ec570-f45a-4c28-a924-1dd2e436be6e tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1756 microversion: 2.1 time: 0.165242 Sep 01 00:40:36.256538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 475/949] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:36 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:40:37.276834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:40:37.277438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:40:37.283952 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:37.284429 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:37.284887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:37.285569 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:40:37.286017 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:40:37.286433 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:40:37.427399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:40:37.436573 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-2549bceb-a302-4db5-ba04-45ef736baa70 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1759 microversion: 2.1 time: 0.163574 Sep 01 00:40:37.437146 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 475/950] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:40:37 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:41:12.359847 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-572808130"}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:41:12.360438 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:12.362529 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=9 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:41:12.363168 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=29 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:41:12.370352 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:12.370837 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:12.371270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:12.371963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:12.372406 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:12.372859 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:12.501801 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.network.security_group_api [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Removing security group ab36321a-82c7-4ded-ab7b-7bda646e7f41 from port ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f Sep 01 00:41:12.801018 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-56ddb5e9-d3ee-4596-9537-81ccefd1a0ad tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/action" status: 202 len: 0 microversion: 2.1 time: 0.445145 Sep 01 00:41:12.808522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 476/951] 10.222.0.25 () {60 vars in 1278 bytes} [Thu Sep 1 00:41:12 2022] POST /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:41:12.812059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=7 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:41:12.813198 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=23 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:41:12.909125 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-9c49a781-5882-42cb-8810-a3cd31be8406 req-a7dc5b16-acad-4e45-92d3-36975dfacb5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:41:12.918949 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9c49a781-5882-42cb-8810-a3cd31be8406 req-a7dc5b16-acad-4e45-92d3-36975dfacb5e service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:12.919417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9c49a781-5882-42cb-8810-a3cd31be8406 req-a7dc5b16-acad-4e45-92d3-36975dfacb5e service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:12.920073 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-9c49a781-5882-42cb-8810-a3cd31be8406 req-a7dc5b16-acad-4e45-92d3-36975dfacb5e service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:12.931871 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-9c49a781-5882-42cb-8810-a3cd31be8406 req-a7dc5b16-acad-4e45-92d3-36975dfacb5e service nova] Creating event network-changed:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:41:12.937112 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-9c49a781-5882-42cb-8810-a3cd31be8406 req-a7dc5b16-acad-4e45-92d3-36975dfacb5e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130685 Sep 01 00:41:12.937709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 476/952] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:41:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:41:13.889315 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:13.897262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:13.904641 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:13.905131 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:13.905565 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:13.906268 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:13.906713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:13.907135 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:13.955448 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-e5b6bb69-7351-40c2-ae3a-b34ab97984b3 req-26d164f8-2c38-4b0d-b4f6-08c5db65eeb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:41:13.965265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e5b6bb69-7351-40c2-ae3a-b34ab97984b3 req-26d164f8-2c38-4b0d-b4f6-08c5db65eeb1 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:13.965646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e5b6bb69-7351-40c2-ae3a-b34ab97984b3 req-26d164f8-2c38-4b0d-b4f6-08c5db65eeb1 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:13.966266 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-e5b6bb69-7351-40c2-ae3a-b34ab97984b3 req-26d164f8-2c38-4b0d-b4f6-08c5db65eeb1 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:13.977721 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-e5b6bb69-7351-40c2-ae3a-b34ab97984b3 req-26d164f8-2c38-4b0d-b4f6-08c5db65eeb1 service nova] Creating event network-changed:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:41:13.982670 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-e5b6bb69-7351-40c2-ae3a-b34ab97984b3 req-26d164f8-2c38-4b0d-b4f6-08c5db65eeb1 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091355 Sep 01 00:41:13.986183 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 477/953] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:41:14.003820 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lazy-loading 'services' on Instance uuid 53c819e3-2012-4f52-a59b-6a11c3e85dbd {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:41:14.088046 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-cce1dfb0-dad9-4228-a33e-732a30451196 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments/a69698bb-3605-462f-a097-907a879ae645" status: 202 len: 0 microversion: 2.1 time: 0.202656 Sep 01 00:41:14.088872 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 477/954] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:41:13 2022] DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments/a69698bb-3605-462f-a097-907a879ae645 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:41:14.097623 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:14.100725 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:14.108284 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:14.109431 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:14.110139 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:14.111374 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:14.112101 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:14.112756 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:14.164344 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a5c1b18a-29b2-4f65-916f-81d1c4a7edb7 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070973 Sep 01 00:41:14.165589 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 478/955] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:41:14 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:41:15.177808 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:15.180780 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:15.186926 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:15.187407 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:15.187842 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:15.188567 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:15.189030 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:15.189457 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:15.217425 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-246c6b1a-9f05-4dca-a034-4acfb4e7769c tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044558 Sep 01 00:41:15.217969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 478/956] 10.222.0.25 () {58 vars in 1302 bytes} [Thu Sep 1 00:41:15 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 01 00:41:15.229360 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:15.229907 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:15.236433 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:15.236943 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:15.237415 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:15.238138 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:15.238583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:15.239000 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:15.313209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] HTTP exception thrown: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd is not attached to volume a69698bb-3605-462f-a097-907a879ae645 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Request method failure captured: Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments/a69698bb-3605-462f-a097-907a879ae645 HTTP/1.1 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_8suzUokG8Qy-eC1weki-wiuqjwf0YNKt9ymn1OzjAFkz7OdcxiTIfJ-54dnEXlATDuoHaS87wAv3uwg25jVf-7C0AhU0-VC75iqBK0amyeuwlKomq4jead7smE4nKCnD7XA-bS_QN8a2dtY-0r-RttEj-wwNUC0STi7OkyW0WJFug Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: a22a4b4aab87497eb1f8b1bce8cd17d5 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestMinimumBasicScenario-865915185 Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:41:15.315572 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a22a4b4aab87497eb1f8b1bce8cd17d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a22a4b4aab87497eb1f8b1bce8cd17d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a22a4b4aab87497eb1f8b1bce8cd17d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a22a4b4aab87497eb1f8b1bce8cd17d5"}]}] Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestMinimumBasicScenario-865915185 Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: a22a4b4aab87497eb1f8b1bce8cd17d5 Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestMinimumBasicScenario-865915185 Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-TestMinimumBasicScenario-865915185-project Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: d7396c3776b744328babae60d6cfb6fd Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestMinimumBasicScenario-865915185-project Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:41:15.317335 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd is not attached to volume a69698bb-3605-462f-a097-907a879ae645 Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'server_id': '53c819e3-2012-4f52-a59b-6a11c3e85dbd', 'id': 'a69698bb-3605-462f-a097-907a879ae645'} Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a69698bb-3605-462f-a097-907a879ae645. Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:41:15.318268 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd is not attached to volume a69698bb-3605-462f-a097-907a879ae645 Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd is not attached to volume a69698bb-3605-462f-a097-907a879ae645 Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:15.319793 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Returning 404 to user: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd is not attached to volume a69698bb-3605-462f-a097-907a879ae645 {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:41:15.321034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5d64b673-f8bf-4795-8cf2-51e82d21ffe4 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments/a69698bb-3605-462f-a097-907a879ae645" status: 404 len: 154 microversion: 2.1 time: 0.092643 Sep 01 00:41:15.321034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 479/957] 10.222.0.25 () {58 vars in 1416 bytes} [Thu Sep 1 00:41:15 2022] DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd/os-volume_attachments/a69698bb-3605-462f-a097-907a879ae645 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:41:16.455412 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:16.455904 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:16.462302 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:16.462777 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:16.463208 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:16.463889 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:16.464332 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:16.464782 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:16.488784 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:41:16.562940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-376457bf-deb0-4b58-a5c5-89b2c284adbd tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 204 len: 0 microversion: 2.1 time: 0.111171 Sep 01 00:41:16.563538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 479/958] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:41:16 2022] DELETE /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:41:16.573997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:16.574608 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:16.581168 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:16.581642 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:16.582107 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:16.582788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:16.583231 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:16.583649 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:16.712716 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:41:16.720322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-333b8806-1a96-4d9e-82b7-006032b37dca tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1554 microversion: 2.1 time: 0.152423 Sep 01 00:41:16.720911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 480/959] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:41:16 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:41:17.741839 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:17.742558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:17.748867 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:17.749342 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:17.749771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:17.750456 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:17.750899 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:17.751317 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:17.884347 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:41:17.892002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5a5bf15e-1f95-4bfd-9c9e-2a2a35688bdb tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1554 microversion: 2.1 time: 0.154334 Sep 01 00:41:17.892589 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 480/960] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:41:17 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:41:18.913511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:18.914686 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:18.921094 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:18.921584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:18.922021 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:18.922723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:18.923172 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:18.923601 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:19.071170 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7396c3776b744328babae60d6cfb6fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a22a4b4aab87497eb1f8b1bce8cd17d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:41:19.079137 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a9c9bb85-6202-475c-b9ee-be0c429d04e6 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 200 len: 1554 microversion: 2.1 time: 0.169446 Sep 01 00:41:19.079709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 481/961] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:41:18 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 1554 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:41:19.086485 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-50f296e2-f85a-4532-881f-039791d05d8c req-037ae768-976e-4dcf-8b79-754184fd2450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53c819e3-2012-4f52-a59b-6a11c3e85dbd", "name": "network-vif-deleted", "tag": "ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:41:19.096187 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-50f296e2-f85a-4532-881f-039791d05d8c req-037ae768-976e-4dcf-8b79-754184fd2450 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:19.096707 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-50f296e2-f85a-4532-881f-039791d05d8c req-037ae768-976e-4dcf-8b79-754184fd2450 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:19.097141 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-50f296e2-f85a-4532-881f-039791d05d8c req-037ae768-976e-4dcf-8b79-754184fd2450 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:19.109329 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-50f296e2-f85a-4532-881f-039791d05d8c req-037ae768-976e-4dcf-8b79-754184fd2450 service nova] Creating event network-vif-deleted:ef1d91cf-c1a8-4190-9f86-1ec7cce00a3f for instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd on hv-cinder-82002 Sep 01 00:41:19.113969 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-50f296e2-f85a-4532-881f-039791d05d8c req-037ae768-976e-4dcf-8b79-754184fd2450 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031171 Sep 01 00:41:19.114584 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 481/962] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:41:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:41:20.099179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:20.099813 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] [instance: 53c819e3-2012-4f52-a59b-6a11c3e85dbd] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:41:20.106925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:20.107405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:20.107839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:20.108559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:41:20.109018 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:41:20.109444 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:41:20.122551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] HTTP exception thrown: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd could not be found. Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Request method failure captured: Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd HTTP/1.1 Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_8suzUokG8Qy-eC1weki-wiuqjwf0YNKt9ymn1OzjAFkz7OdcxiTIfJ-54dnEXlATDuoHaS87wAv3uwg25jVf-7C0AhU0-VC75iqBK0amyeuwlKomq4jead7smE4nKCnD7XA-bS_QN8a2dtY-0r-RttEj-wwNUC0STi7OkyW0WJFug Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: a22a4b4aab87497eb1f8b1bce8cd17d5 Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestMinimumBasicScenario-865915185 Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:41:20.124054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_a22a4b4aab87497eb1f8b1bce8cd17d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/a22a4b4aab87497eb1f8b1bce8cd17d5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a22a4b4aab87497eb1f8b1bce8cd17d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/a22a4b4aab87497eb1f8b1bce8cd17d5"}]}] Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestMinimumBasicScenario-865915185 Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: a22a4b4aab87497eb1f8b1bce8cd17d5 Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestMinimumBasicScenario-865915185 Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-TestMinimumBasicScenario-865915185-project Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: d7396c3776b744328babae60d6cfb6fd Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestMinimumBasicScenario-865915185-project Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd could not be found. Sep 01 00:41:20.125682 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '53c819e3-2012-4f52-a59b-6a11c3e85dbd'} Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd could not be found. Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:41:20.126754 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd could not be found. Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd could not be found. Sep 01 00:41:20.128302 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:41:20.129705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Returning 404 to user: Instance 53c819e3-2012-4f52-a59b-6a11c3e85dbd could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:41:20.129705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fc22b661-36bd-43c6-b35c-ea26da6d9cde tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd" status: 404 len: 111 microversion: 2.1 time: 0.030184 Sep 01 00:41:20.129705 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 482/963] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:41:20 2022] GET /compute/v2.1/servers/53c819e3-2012-4f52-a59b-6a11c3e85dbd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:41:20.135390 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-2d2edfce-1f79-4ac3-a28b-97f57a7c8929 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] Calling method '.version_select at 0x7fcadfcb10d0>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:41:20.154281 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-2d2edfce-1f79-4ac3-a28b-97f57a7c8929 tempest-TestMinimumBasicScenario-865915185 tempest-TestMinimumBasicScenario-865915185-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-196989010" status: 202 len: 0 microversion: 2.1 time: 0.023751 Sep 01 00:41:20.154898 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 482/964] 10.222.0.25 () {58 vars in 1269 bytes} [Thu Sep 1 00:41:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-196989010 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 01 00:42:10.526738 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:10.527304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:10.529270 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=14 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:10.529910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=30 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:10.537578 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:10.538061 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:10.538498 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:10.539196 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:10.539653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:10.540079 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:10.569417 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Going to try to terminate instance {{(pid=132498) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:42:10.644049 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-af9eb358-c34b-4da3-ae75-9d7ddd97d186 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 204 len: 0 microversion: 2.1 time: 0.121091 Sep 01 00:42:10.644673 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 483/965] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:42:10 2022] DELETE /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:42:10.653292 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:10.654029 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:10.656151 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:10.656864 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:10.658842 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 01 00:42:10.667570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:10.668055 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:10.668514 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:10.669232 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:10.669686 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:10.670112 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:10.805038 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:10.812686 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-8ff0bc77-2d99-4b69-a726-94b4d223a54e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1580 microversion: 2.1 time: 0.163759 Sep 01 00:42:10.813255 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 483/966] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:10 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1580 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:11.834287 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:11.835001 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:11.841584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:11.842059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:11.842489 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:11.843165 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:11.843609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:11.844026 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:11.979191 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:11.987709 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-7068cb9b-b69c-4c20-b0a2-87ea27026056 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1580 microversion: 2.1 time: 0.157564 Sep 01 00:42:11.988294 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 484/967] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:11 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1580 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:13.008684 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:13.009306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:13.015695 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:13.016189 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:13.016734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:13.017525 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:13.017995 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:13.018429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:13.112944 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:13.120630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-74eadf54-09ed-44a5-8d37-766fd8ef0bd5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1512 microversion: 2.1 time: 0.115861 Sep 01 00:42:13.121442 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 484/968] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:13 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1512 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:13.372311 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-f198cb9c-1ca3-4b27-a6c9-ab41589d11fe req-8d0750b5-cb3d-4b58-863c-3fb993cc82fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c472673e-4179-483d-a44f-d9a4fe49b434", "name": "network-vif-deleted", "tag": "d3208c8e-df8b-4d14-9287-98e93f1ba938"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:42:13.383622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-f198cb9c-1ca3-4b27-a6c9-ab41589d11fe req-8d0750b5-cb3d-4b58-863c-3fb993cc82fc service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:13.384150 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-f198cb9c-1ca3-4b27-a6c9-ab41589d11fe req-8d0750b5-cb3d-4b58-863c-3fb993cc82fc service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:13.384609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-f198cb9c-1ca3-4b27-a6c9-ab41589d11fe req-8d0750b5-cb3d-4b58-863c-3fb993cc82fc service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:13.407629 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-f198cb9c-1ca3-4b27-a6c9-ab41589d11fe req-8d0750b5-cb3d-4b58-863c-3fb993cc82fc service nova] Creating event network-vif-deleted:d3208c8e-df8b-4d14-9287-98e93f1ba938 for instance c472673e-4179-483d-a44f-d9a4fe49b434 on hv-cinder-82002 Sep 01 00:42:13.416834 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-f198cb9c-1ca3-4b27-a6c9-ab41589d11fe req-8d0750b5-cb3d-4b58-863c-3fb993cc82fc service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046925 Sep 01 00:42:13.417459 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 485/969] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:42:14.142385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:14.143742 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:14.151713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:14.152611 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:14.153312 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:14.154245 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:14.154915 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:14.155551 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:14.194158 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:14.194650 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:14.195085 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:14.196270 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.objects.instance [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lazy-loading 'fault' on Instance uuid c472673e-4179-483d-a44f-d9a4fe49b434 {{(pid=132496) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Sep 01 00:42:14.240241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:14.247507 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-fda9fd89-485e-43a1-8944-802721985755 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 200 len: 1185 microversion: 2.1 time: 0.109551 Sep 01 00:42:14.248086 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 485/970] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:14 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 1185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:15.268977 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:15.269666 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:15.276250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:15.276755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:15.277189 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:15.277875 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:15.278322 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:15.278738 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:15.291713 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] HTTP exception thrown: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Request method failure captured: Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 HTTP/1.1 Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_9IH0IwAzBl9XtT4XVAgHTZO2_cm7kJGpW0qkv7LamO2PFAoB5PSQm2hZAvqlt7GheNl2c83_1v2m7qTytI7H3lVAm7lRl7KysB3WJf4VVCJnDDgkxPI0HD4BYCF30Gz86_RcD6X3bs-EfA-BG9YDnbEjDo56lPbntdKI0XGD2wor0 Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:42:15.293324 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}] Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 048aba7c5b364b07abf7f6b8977d167a Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:42:15.295059 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'c472673e-4179-483d-a44f-d9a4fe49b434'} Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:42:15.296074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:42:15.297788 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:42:15.299839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Returning 404 to user: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:42:15.299839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-80c28ee2-d7cb-42ab-bf43-8a2eb0239a92 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 404 len: 111 microversion: 2.1 time: 0.029923 Sep 01 00:42:15.299839 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 486/971] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:15 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:42:15.391958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-686116902", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2019141328", "security_groups": [{"name": "tempest-secgroup-smoke-1194673048"}], "block_device_mapping_v2": [{"uuid": "d1a159b9-df3f-42f4-be49-257192d2bbab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28512075-6511-4bf7-8914-a7d1b95a8073"}]}} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:42:15.506434 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.network.neutron [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] validate_networks() for [('28512075-6511-4bf7-8914-a7d1b95a8073', None, None, None, None, None)] {{(pid=132496) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:42:15.875362 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Flavor limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:42:15.875812 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Image limits 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:42:15.876286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Flavor pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:42:15.876738 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Image pref 0:0:0 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:42:15.877184 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.virt.hardware [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132496) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:42:15.885821 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:15.886299 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:15.886737 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:15.887459 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:15.887908 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:15.888333 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:15.905955 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for project 31e9903e4f16471d8057ee7364cf123b. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:42:15.910196 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.quota [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for user 048aba7c5b364b07abf7f6b8977d167a and project 31e9903e4f16471d8057ee7364cf123b. Resources: {'instances', 'ram', 'cores'} {{(pid=132496) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:42:15.969244 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Going to run 1 instances... {{(pid=132496) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:42:15.971940 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d1a159b9-df3f-42f4-be49-257192d2bbab',volume_size=None,volume_type=None)] {{(pid=132496) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:42:16.099350 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-9de1bbe3-4fcb-4914-bb44-4c2cf37a3c69 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.711174 Sep 01 00:42:16.099991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 486/972] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:42:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:42:16.110847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-fe33db49-b1de-4744-9909-fe8390b3cd2a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:16.111559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-fe33db49-b1de-4744-9909-fe8390b3cd2a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:16.169580 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-fe33db49-b1de-4744-9909-fe8390b3cd2a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:16.176567 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-fe33db49-b1de-4744-9909-fe8390b3cd2a tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1094 microversion: 2.1 time: 0.069583 Sep 01 00:42:16.177144 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 487/973] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:16 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:17.196776 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:17.197353 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:17.203239 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:17.203719 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:17.204159 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:17.204871 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:17.205318 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:17.205810 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:17.559714 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:17.570534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a6cfc0b4-9e33-4591-bd47-73e2da699816 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1200 microversion: 2.1 time: 0.378171 Sep 01 00:42:17.571114 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 487/974] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:17 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1200 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:18.592991 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:18.593568 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:18.600734 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:18.601219 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:18.601645 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:18.602340 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:18.602789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:18.603207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:18.736072 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:18.745242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-504367b7-7a60-477a-afe8-743f261c0fc3 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.156492 Sep 01 00:42:18.745807 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 488/975] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:18 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:18.843437 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-e770dd23-618c-439c-9e55-dafc01d5d8c7 req-80ac2239-cf5d-4437-a039-6cb72ba024f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8e6f70-6e87-47d0-8d38-75dad700ec31", "tag": "6298d4b7-4066-46b0-b87e-46e160ffece2"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:42:18.853643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e770dd23-618c-439c-9e55-dafc01d5d8c7 req-80ac2239-cf5d-4437-a039-6cb72ba024f0 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:18.854122 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e770dd23-618c-439c-9e55-dafc01d5d8c7 req-80ac2239-cf5d-4437-a039-6cb72ba024f0 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:18.854552 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-e770dd23-618c-439c-9e55-dafc01d5d8c7 req-80ac2239-cf5d-4437-a039-6cb72ba024f0 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:18.867124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-e770dd23-618c-439c-9e55-dafc01d5d8c7 req-80ac2239-cf5d-4437-a039-6cb72ba024f0 service nova] Creating event network-changed:6298d4b7-4066-46b0-b87e-46e160ffece2 for instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 on hv-cinder-82002 Sep 01 00:42:18.871977 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-e770dd23-618c-439c-9e55-dafc01d5d8c7 req-80ac2239-cf5d-4437-a039-6cb72ba024f0 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032745 Sep 01 00:42:18.872599 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 488/976] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:42:19.766997 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:19.767525 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:19.774616 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:19.775097 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:19.775577 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:19.776213 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:19.776691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:19.777148 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:19.915813 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:19.923694 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9a406015-7317-4539-94ad-166759ffec23 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.160690 Sep 01 00:42:19.924265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 489/977] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:19 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:20.948051 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:20.948786 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:20.955241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:20.955740 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:20.957365 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:20.958090 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:20.958550 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:20.958985 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:21.110921 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:21.118907 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bbdceb65-aa16-4753-a797-a6b856630f29 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.177093 Sep 01 00:42:21.119500 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 489/978] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:20 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:22.139339 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:22.139928 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:22.146451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:22.146927 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:22.147363 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:22.148056 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:22.148526 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:22.148957 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:22.281162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:22.289831 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-62d6a9de-c7df-4caa-bb0e-9450d88ee2fe tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.154360 Sep 01 00:42:22.290451 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 490/979] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:22 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:23.311124 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:23.311764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:23.318957 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:23.319436 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:23.319863 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:23.320573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:23.321020 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:23.321439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:23.449385 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:23.457009 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-67e0645e-3cd6-4c03-9811-b5e6223ec962 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.149752 Sep 01 00:42:23.457570 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 490/980] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:23 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:24.477848 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:24.478453 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:24.484767 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:24.485252 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:24.485683 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:24.486380 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:24.486819 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:24.487242 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:24.618290 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:24.625932 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-713bef4b-824e-4df1-84cb-bf2b54ea7bac tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.151988 Sep 01 00:42:24.626491 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 491/981] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:24 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:25.646666 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:25.647274 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:25.653574 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:25.654053 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:25.654483 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:25.655170 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:25.655614 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:25.656033 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:25.787958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:25.795552 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-d4356521-3dfd-4b4f-93f5-c8d39436ffd2 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.152901 Sep 01 00:42:25.796121 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 491/982] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:25 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:26.815176 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:26.815783 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:26.818456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:26.823590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:26.824066 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:26.824512 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:26.825209 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:26.825656 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:26.826076 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:26.960072 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:26.968775 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-3a0385fc-5bd6-434f-a999-6f22bf038c87 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.157425 Sep 01 00:42:26.969371 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 492/983] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:26 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:27.990538 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:27.991146 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:27.993116 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:27.993787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=6 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:42:28.000828 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:28.001306 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:28.001736 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:28.002424 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:28.002870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:28.003286 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:28.134120 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:28.142841 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e2b4f67e-3b67-4375-8e6b-74e006661e68 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.157067 Sep 01 00:42:28.143429 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 492/984] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:27 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:42:29.164438 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:29.165077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:29.171584 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:29.172003 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:29.172437 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:29.173152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:29.173602 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:29.174025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:29.303655 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:29.311200 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ad969d38-13f8-40d0-a031-6dcc880f9a32 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.150998 Sep 01 00:42:29.311757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 493/985] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:29 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:29.985576 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-1cd0d7fe-7e44-4d7d-bd10-65ae7e138730 req-b16a5e08-041a-4da0-b5f4-abaa01e07673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8e6f70-6e87-47d0-8d38-75dad700ec31", "name": "network-vif-plugged", "status": "completed", "tag": "6298d4b7-4066-46b0-b87e-46e160ffece2"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:42:29.995458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-1cd0d7fe-7e44-4d7d-bd10-65ae7e138730 req-b16a5e08-041a-4da0-b5f4-abaa01e07673 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:29.995936 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-1cd0d7fe-7e44-4d7d-bd10-65ae7e138730 req-b16a5e08-041a-4da0-b5f4-abaa01e07673 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:29.996364 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-1cd0d7fe-7e44-4d7d-bd10-65ae7e138730 req-b16a5e08-041a-4da0-b5f4-abaa01e07673 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:30.007840 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-1cd0d7fe-7e44-4d7d-bd10-65ae7e138730 req-b16a5e08-041a-4da0-b5f4-abaa01e07673 service nova] Creating event network-vif-plugged:6298d4b7-4066-46b0-b87e-46e160ffece2 for instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 on hv-cinder-82002 Sep 01 00:42:30.013148 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-1cd0d7fe-7e44-4d7d-bd10-65ae7e138730 req-b16a5e08-041a-4da0-b5f4-abaa01e07673 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149242 Sep 01 00:42:30.013713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 493/986] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:42:30.331283 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:30.331888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:30.339015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:30.339496 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:30.339941 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:30.340665 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:30.341119 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:30.341541 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:30.474399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:30.482094 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9982be29-7de2-461a-89d5-a5a6576b0112 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1266 microversion: 2.1 time: 0.154820 Sep 01 00:42:30.482661 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 494/987] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:30 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:31.503519 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:31.504161 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:31.510961 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:31.511439 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:31.511876 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:31.512590 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:31.513039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:31.513460 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:31.651573 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:31.659165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-ab6d0424-5a89-4511-9037-d898a334d7e8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1453 microversion: 2.1 time: 0.160018 Sep 01 00:42:31.659723 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 494/988] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:31 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:31.678966 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:42:31.679590 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:42:31.685847 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:31.686326 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:31.686755 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:31.687441 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:31.687887 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:31.688304 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:31.819738 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:42:31.827346 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-74607929-6b93-437e-8b98-c92efa41f17d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1453 microversion: 2.1 time: 0.152314 Sep 01 00:42:31.827907 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 495/989] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:42:31 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:42:33.681691 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-c0664649-2a6a-464a-a763-0182070bb2d1 req-9314bfbe-4f7e-40de-a51b-f637cca027d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8e6f70-6e87-47d0-8d38-75dad700ec31", "tag": "6298d4b7-4066-46b0-b87e-46e160ffece2"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:42:33.691144 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-c0664649-2a6a-464a-a763-0182070bb2d1 req-9314bfbe-4f7e-40de-a51b-f637cca027d5 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:42:33.691615 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-c0664649-2a6a-464a-a763-0182070bb2d1 req-9314bfbe-4f7e-40de-a51b-f637cca027d5 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:42:33.692039 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-c0664649-2a6a-464a-a763-0182070bb2d1 req-9314bfbe-4f7e-40de-a51b-f637cca027d5 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:42:33.703084 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-c0664649-2a6a-464a-a763-0182070bb2d1 req-9314bfbe-4f7e-40de-a51b-f637cca027d5 service nova] Creating event network-changed:6298d4b7-4066-46b0-b87e-46e160ffece2 for instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 on hv-cinder-82002 Sep 01 00:42:33.708216 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-c0664649-2a6a-464a-a763-0182070bb2d1 req-9314bfbe-4f7e-40de-a51b-f637cca027d5 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030669 Sep 01 00:42:33.709372 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 495/990] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:42:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:44:08.287323 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:08.288050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:08.289162 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 00:44:08.289327 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Thu Sep 1 00:44:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.25) !!! Sep 01 00:44:08.293962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-128291138", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-2019141328", "security_groups": [{"name": "tempest-secgroup-smoke-1194673048"}], "block_device_mapping_v2": [{"uuid": "97a33167-6b34-403e-b574-0110d2d7d074", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "28512075-6511-4bf7-8914-a7d1b95a8073"}]}} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:44:08.410648 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.network.neutron [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] validate_networks() for [('28512075-6511-4bf7-8914-a7d1b95a8073', None, None, None, None, None)] {{(pid=132498) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Sep 01 00:44:08.882520 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Flavor limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 01 00:44:08.882939 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Image limits 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 01 00:44:08.883406 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Flavor pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 01 00:44:08.883810 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Image pref 0:0:0 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 01 00:44:08.884219 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.virt.hardware [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=132498) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 01 00:44:08.892888 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:08.893368 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:08.893800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:08.894515 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:08.894962 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:08.895497 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:08.912607 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for project 31e9903e4f16471d8057ee7364cf123b. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 01 00:44:08.916456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.quota [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Getting quotas for user 048aba7c5b364b07abf7f6b8977d167a and project 31e9903e4f16471d8057ee7364cf123b. Resources: {'instances', 'ram', 'cores'} {{(pid=132498) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 01 00:44:08.973040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Going to run 1 instances... {{(pid=132498) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 01 00:44:08.975723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97a33167-6b34-403e-b574-0110d2d7d074',volume_size=None,volume_type=None)] {{(pid=132498) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 01 00:44:09.108226 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-efa7f228-1a03-4d8a-adf6-0a6840b62420 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.822471 Sep 01 00:44:09.108925 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 496/991] 10.222.0.25 () {60 vars in 1147 bytes} [Thu Sep 1 00:44:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 01 00:44:09.118741 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:09.119903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=64 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:09.121176 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 00:44:09.121522 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Thu Sep 1 00:44:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da (ip 10.222.0.25) !!! Sep 01 00:44:09.130870 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a0be005d-cc5d-4fb8-82a5-3ad456da2d9f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:09.131761 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a0be005d-cc5d-4fb8-82a5-3ad456da2d9f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:09.193181 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a0be005d-cc5d-4fb8-82a5-3ad456da2d9f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:09.200051 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a0be005d-cc5d-4fb8-82a5-3ad456da2d9f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1094 microversion: 2.1 time: 0.083430 Sep 01 00:44:09.200759 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 496/992] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:09 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1094 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:10.221312 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:10.222646 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:10.231394 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:10.232085 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:10.232633 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:10.233442 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:10.234020 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:10.234535 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:10.307566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:10.315514 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-025eb91c-f13f-47dc-9c7c-f745892a2be5 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1200 microversion: 2.1 time: 0.099000 Sep 01 00:44:10.316946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 497/993] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:10 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1200 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:11.337655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:11.338276 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:11.346117 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:11.346643 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:11.347249 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:11.347958 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:11.348417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:11.348887 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:11.548799 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:11.557083 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-911ceda5-7e7f-46b8-8814-0c4729d68905 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.223563 Sep 01 00:44:11.557647 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 497/994] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:11 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:11.632207 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-06963bc0-6ac3-452c-b82e-7bdf4f8d9499 req-2424ffe6-6e38-47a6-a1fe-68992ed4a9c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c88d3d-4c67-40c2-b901-afef792932da", "tag": "6fea6d48-c251-4c63-a7dd-5e5659cc5757"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:44:11.645956 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-06963bc0-6ac3-452c-b82e-7bdf4f8d9499 req-2424ffe6-6e38-47a6-a1fe-68992ed4a9c8 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:11.647695 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-06963bc0-6ac3-452c-b82e-7bdf4f8d9499 req-2424ffe6-6e38-47a6-a1fe-68992ed4a9c8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:11.648309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-06963bc0-6ac3-452c-b82e-7bdf4f8d9499 req-2424ffe6-6e38-47a6-a1fe-68992ed4a9c8 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:11.662100 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-06963bc0-6ac3-452c-b82e-7bdf4f8d9499 req-2424ffe6-6e38-47a6-a1fe-68992ed4a9c8 service nova] Creating event network-changed:6fea6d48-c251-4c63-a7dd-5e5659cc5757 for instance 42c88d3d-4c67-40c2-b901-afef792932da on hv-cinder-82002 Sep 01 00:44:11.667914 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-06963bc0-6ac3-452c-b82e-7bdf4f8d9499 req-2424ffe6-6e38-47a6-a1fe-68992ed4a9c8 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039695 Sep 01 00:44:11.668855 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 498/995] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:44:12.577906 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:12.578518 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:12.585025 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:12.585504 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:12.585997 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:12.586688 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:12.587135 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:12.587558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:12.725576 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:12.733677 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-44f97bf7-9902-494c-aed2-bb2d58cd754e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.159740 Sep 01 00:44:12.734234 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 498/996] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:12 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:13.755859 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:13.756789 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:13.762685 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:13.763166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:13.763603 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:13.764273 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:13.764746 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:13.765165 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:13.897363 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:13.904956 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-5fdf9891-28d6-4508-8c02-f65d0594b13d tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.153798 Sep 01 00:44:13.905524 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 499/997] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:13 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:14.925987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:14.926583 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:14.933636 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:14.934123 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:14.934562 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:14.935259 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:14.935717 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:14.936142 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:15.064744 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:15.072575 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-acc094cd-9e35-4af8-a966-332374fa3470 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.150777 Sep 01 00:44:15.073142 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 499/998] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:14 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:16.092966 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:16.093576 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:16.099946 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:16.100429 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:16.100894 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:16.101587 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:16.102034 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:16.102456 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:16.230309 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:16.238369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d2298b6c-4a50-4d03-9ba8-531382f4435b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.149250 Sep 01 00:44:16.238936 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 500/999] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:16 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:17.259641 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:17.260260 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:17.266710 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:17.267200 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:17.267637 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:17.268414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:17.268895 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:17.269324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:17.398856 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:17.407568 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bc17f78a-477b-41b0-b7b6-fcaac1ddaa4e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.152180 Sep 01 00:44:17.408547 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 500/1000] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:17 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:18.428025 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:18.428664 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:18.435267 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:18.435746 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:18.436182 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:18.436896 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:18.437348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:18.437772 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:18.568381 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:18.577211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-ddb7054d-9e15-4ce9-98a5-45902c7f3f63 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.153116 Sep 01 00:44:18.577774 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 501/1001] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:18 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:19.598413 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:19.599021 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:19.601416 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell0:SELECT=2 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:19.607405 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:19.607876 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:19.608308 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:19.609031 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:19.609480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:19.609899 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:19.741950 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:19.749630 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-e669f940-ee35-4f27-9bd7-ec30ca9a4a38 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.155034 Sep 01 00:44:19.750188 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 501/1002] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:19 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:20.770040 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:20.770561 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:20.772511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=2 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:20.773164 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell0:SELECT=6 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:44:20.779800 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:20.780281 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:20.780742 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:20.781469 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:20.781917 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:20.782342 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:20.912923 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:20.922253 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-9c39967e-2256-497a-8573-4c6d5453385e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.156016 Sep 01 00:44:20.923179 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 502/1003] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:20 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:21.943408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:21.943986 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:21.951337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:21.951826 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:21.952264 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:21.953002 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:21.953458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:21.953883 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:22.114252 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:22.122664 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-a1906513-09fc-4100-aab7-64dd3a123fa8 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.183132 Sep 01 00:44:22.123238 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 502/1004] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:21 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:22.520609 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-a4f992cd-6fc4-4ecf-b02a-e3daed2c47fe req-3b7ce537-e523-404d-84e9-2f45026f9c72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c88d3d-4c67-40c2-b901-afef792932da", "name": "network-vif-plugged", "status": "completed", "tag": "6fea6d48-c251-4c63-a7dd-5e5659cc5757"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:44:22.531513 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a4f992cd-6fc4-4ecf-b02a-e3daed2c47fe req-3b7ce537-e523-404d-84e9-2f45026f9c72 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:22.532007 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a4f992cd-6fc4-4ecf-b02a-e3daed2c47fe req-3b7ce537-e523-404d-84e9-2f45026f9c72 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:22.532410 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-a4f992cd-6fc4-4ecf-b02a-e3daed2c47fe req-3b7ce537-e523-404d-84e9-2f45026f9c72 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:22.546249 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-a4f992cd-6fc4-4ecf-b02a-e3daed2c47fe req-3b7ce537-e523-404d-84e9-2f45026f9c72 service nova] Creating event network-vif-plugged:6fea6d48-c251-4c63-a7dd-5e5659cc5757 for instance 42c88d3d-4c67-40c2-b901-afef792932da on hv-cinder-82002 Sep 01 00:44:22.551727 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-a4f992cd-6fc4-4ecf-b02a-e3daed2c47fe req-3b7ce537-e523-404d-84e9-2f45026f9c72 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034927 Sep 01 00:44:22.552718 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 503/1005] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:44:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:44:23.145341 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:23.145928 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:23.152919 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:23.153401 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:23.153835 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:23.154534 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:23.154986 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:23.155414 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:23.284715 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:23.292389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-775d6488-410a-4769-85ae-ce8539926a2f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1266 microversion: 2.1 time: 0.150882 Sep 01 00:44:23.292978 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 503/1006] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:23 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:24.312698 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:24.313388 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:24.320132 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:24.320643 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:24.321099 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:24.321790 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:24.322234 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:24.322651 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:24.460910 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:24.469511 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-a7bb2607-ccd4-41a5-8969-18fbd2e2f93f tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1453 microversion: 2.1 time: 0.161031 Sep 01 00:44:24.470074 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 504/1007] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:24 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:24.489734 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:44:24.490348 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:44:24.496745 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:24.497224 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:24.497658 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:24.498340 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:24.498787 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:24.499206 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:24.631214 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:44:24.639399 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0d7465f7-492e-47ec-8423-dea8b26542d1 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1453 microversion: 2.1 time: 0.153445 Sep 01 00:44:24.639963 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 504/1008] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:44:24 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:44:26.214744 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-bb4976e1-f6f2-4c5b-a8b9-97617e6b8616 req-1cc43c62-fbe8-4e80-891e-2c53b8c7a56e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c88d3d-4c67-40c2-b901-afef792932da", "tag": "6fea6d48-c251-4c63-a7dd-5e5659cc5757"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:44:26.224348 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-bb4976e1-f6f2-4c5b-a8b9-97617e6b8616 req-1cc43c62-fbe8-4e80-891e-2c53b8c7a56e service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:44:26.224861 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-bb4976e1-f6f2-4c5b-a8b9-97617e6b8616 req-1cc43c62-fbe8-4e80-891e-2c53b8c7a56e service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:44:26.225296 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-bb4976e1-f6f2-4c5b-a8b9-97617e6b8616 req-1cc43c62-fbe8-4e80-891e-2c53b8c7a56e service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:44:26.237630 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-bb4976e1-f6f2-4c5b-a8b9-97617e6b8616 req-1cc43c62-fbe8-4e80-891e-2c53b8c7a56e service nova] Creating event network-changed:6fea6d48-c251-4c63-a7dd-5e5659cc5757 for instance 42c88d3d-4c67-40c2-b901-afef792932da on hv-cinder-82002 Sep 01 00:44:26.242604 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-bb4976e1-f6f2-4c5b-a8b9-97617e6b8616 req-1cc43c62-fbe8-4e80-891e-2c53b8c7a56e service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031715 Sep 01 00:44:26.243216 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 505/1009] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:44:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:46:05.888752 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_api:SELECT=20 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:46:05.892672 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:46:05.893480 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG dbcounter [-] [132496] Writing DB stats nova_cell1:SELECT=48 {{(pid=132496) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:46:05.894060 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG dbcounter [-] [132498] Writing DB stats nova_cell1:SELECT=44 {{(pid=132498) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 00:46:05.894925 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 00:46:05.901232 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-51f60d63-7d6c-4d08-8b06-2e46a09794a2 req-5a514761-ab5b-482d-b637-39d217a7fe0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42c88d3d-4c67-40c2-b901-afef792932da", "tag": "6fea6d48-c251-4c63-a7dd-5e5659cc5757"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:46:05.904584 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Thu Sep 1 00:46:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da (ip 10.222.0.25) !!! Sep 01 00:46:05.905903 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 01 00:46:05.906057 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Thu Sep 1 00:46:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da (ip 10.222.0.25) !!! Sep 01 00:46:05.911954 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:05.912463 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:05.924193 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-51f60d63-7d6c-4d08-8b06-2e46a09794a2 req-5a514761-ab5b-482d-b637-39d217a7fe0f service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:05.924702 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-51f60d63-7d6c-4d08-8b06-2e46a09794a2 req-5a514761-ab5b-482d-b637-39d217a7fe0f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:05.925136 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-51f60d63-7d6c-4d08-8b06-2e46a09794a2 req-5a514761-ab5b-482d-b637-39d217a7fe0f service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:05.932287 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:05.932817 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:05.933262 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:05.933991 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:05.934447 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:05.934877 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:05.937851 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-51f60d63-7d6c-4d08-8b06-2e46a09794a2 req-5a514761-ab5b-482d-b637-39d217a7fe0f service nova] Creating event network-changed:6fea6d48-c251-4c63-a7dd-5e5659cc5757 for instance 42c88d3d-4c67-40c2-b901-afef792932da on hv-cinder-82002 Sep 01 00:46:05.943260 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-51f60d63-7d6c-4d08-8b06-2e46a09794a2 req-5a514761-ab5b-482d-b637-39d217a7fe0f service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052200 Sep 01 00:46:05.944015 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 506/1010] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:46:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:46:05.967545 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:46:06.057134 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-c959e5f4-20b1-4fda-a8a1-fa5c08333d3e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "DELETE /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 204 len: 0 microversion: 2.1 time: 0.169318 Sep 01 00:46:06.058324 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 505/1011] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:46:05 2022] DELETE /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:46:06.068388 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:06.069214 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:06.076291 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:06.077416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:06.077416 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:06.078211 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:06.078667 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:06.079087 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:06.269462 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:46:06.277763 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-b3758360-bb54-473c-bea8-048e0c7a8d93 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1578 microversion: 2.1 time: 0.214035 Sep 01 00:46:06.278331 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 507/1012] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:06 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1578 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 01 00:46:07.299849 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:07.300578 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:07.307115 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:07.307603 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:07.308045 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:07.308767 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:07.309226 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:07.309655 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:07.579335 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:46:07.587070 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-5f8d2adc-069a-4f80-882e-435b08fade2b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1578 microversion: 2.1 time: 0.291491 Sep 01 00:46:07.587779 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 506/1013] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:07 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1578 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:46:08.325874 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-2d5d635a-cb52-41ae-b2d9-bed660e77228 req-7990653a-9a1b-4da1-b255-80c920a5fc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42c88d3d-4c67-40c2-b901-afef792932da", "name": "network-vif-deleted", "tag": "6fea6d48-c251-4c63-a7dd-5e5659cc5757"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:46:08.339077 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2d5d635a-cb52-41ae-b2d9-bed660e77228 req-7990653a-9a1b-4da1-b255-80c920a5fc7b service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:08.339626 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2d5d635a-cb52-41ae-b2d9-bed660e77228 req-7990653a-9a1b-4da1-b255-80c920a5fc7b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:08.340152 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-2d5d635a-cb52-41ae-b2d9-bed660e77228 req-7990653a-9a1b-4da1-b255-80c920a5fc7b service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:08.352566 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-2d5d635a-cb52-41ae-b2d9-bed660e77228 req-7990653a-9a1b-4da1-b255-80c920a5fc7b service nova] Creating event network-vif-deleted:6fea6d48-c251-4c63-a7dd-5e5659cc5757 for instance 42c88d3d-4c67-40c2-b901-afef792932da on hv-cinder-82002 Sep 01 00:46:08.358062 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-2d5d635a-cb52-41ae-b2d9-bed660e77228 req-7990653a-9a1b-4da1-b255-80c920a5fc7b service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036487 Sep 01 00:46:08.358653 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 508/1014] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:46:08.607941 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:08.608481 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:08.614831 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:08.615399 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:08.615843 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:08.617130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:08.617558 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:08.617990 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:08.690608 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:46:08.699668 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-557918d7-2305-43c7-9426-2122f4066d1b tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 200 len: 1225 microversion: 2.1 time: 0.096294 Sep 01 00:46:08.700685 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 507/1015] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:08 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:46:09.723276 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:09.723968 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 42c88d3d-4c67-40c2-b901-afef792932da] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:09.731632 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:09.732106 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:09.732559 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:09.733245 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:09.733691 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:09.734108 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:09.748399 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] HTTP exception thrown: Instance 42c88d3d-4c67-40c2-b901-afef792932da could not be found. Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Request method failure captured: Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da HTTP/1.1 Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_9IH0IwAzBl9XtT4XVAgHTZO2_cm7kJGpW0qkv7LamO2PFAoB5PSQm2hZAvqlt7GheNl2c83_1v2m7qTytI7H3lVAm7lRl7KysB3WJf4VVCJnDDgkxPI0HD4BYCF30Gz86_RcD6X3bs-EfA-BG9YDnbEjDo56lPbntdKI0XGD2wor0 Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:46:09.750009 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}] Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 048aba7c5b364b07abf7f6b8977d167a Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 42c88d3d-4c67-40c2-b901-afef792932da could not be found. Sep 01 00:46:09.751911 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '42c88d3d-4c67-40c2-b901-afef792932da'} Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42c88d3d-4c67-40c2-b901-afef792932da could not be found. Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:46:09.753117 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42c88d3d-4c67-40c2-b901-afef792932da could not be found. Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42c88d3d-4c67-40c2-b901-afef792932da could not be found. Sep 01 00:46:09.754906 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:09.756544 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Returning 404 to user: Instance 42c88d3d-4c67-40c2-b901-afef792932da could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:46:09.756544 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-d3510c0f-f130-44ef-8bb4-889f0750ae2e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da" status: 404 len: 111 microversion: 2.1 time: 0.032510 Sep 01 00:46:09.756544 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 509/1016] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:09 2022] GET /compute/v2.1/servers/42c88d3d-4c67-40c2-b901-afef792932da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:46:12.815137 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:12.815673 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:12.816955 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [req-d1e73c7e-1d42-46aa-a995-169264c3907f req-9b09dc58-3efe-4473-a5c3-925b1c0f7d0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e8e6f70-6e87-47d0-8d38-75dad700ec31", "tag": "6298d4b7-4066-46b0-b87e-46e160ffece2"}]} {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:46:12.822056 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:12.822771 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:12.823440 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:12.824217 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:12.824713 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:12.825705 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:12.827903 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-d1e73c7e-1d42-46aa-a995-169264c3907f req-9b09dc58-3efe-4473-a5c3-925b1c0f7d0a service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:12.828505 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-d1e73c7e-1d42-46aa-a995-169264c3907f req-9b09dc58-3efe-4473-a5c3-925b1c0f7d0a service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:12.829007 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [req-d1e73c7e-1d42-46aa-a995-169264c3907f req-9b09dc58-3efe-4473-a5c3-925b1c0f7d0a service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:12.840421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.compute.server_external_events [req-d1e73c7e-1d42-46aa-a995-169264c3907f req-9b09dc58-3efe-4473-a5c3-925b1c0f7d0a service nova] Creating event network-changed:6298d4b7-4066-46b0-b87e-46e160ffece2 for instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 on hv-cinder-82002 Sep 01 00:46:12.846265 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [req-d1e73c7e-1d42-46aa-a995-169264c3907f req-9b09dc58-3efe-4473-a5c3-925b1c0f7d0a service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 Sep 01 00:46:12.847008 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 510/1017] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 01 00:46:12.858697 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Going to try to terminate instance {{(pid=132496) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 01 00:46:12.941130 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-1995ae49-c898-4102-92fe-a930e458d724 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "DELETE /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 204 len: 0 microversion: 2.1 time: 0.130775 Sep 01 00:46:12.942029 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 508/1018] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:46:12 2022] DELETE /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 01 00:46:12.952383 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:12.953325 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:12.960255 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:12.961106 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:12.961803 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:12.962757 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:12.963421 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:12.964054 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:13.138011 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:46:13.146058 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-12c4b26c-f2a4-41f4-8477-2fe099e6d978 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1577 microversion: 2.1 time: 0.199492 Sep 01 00:46:13.146622 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 511/1019] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:12 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1577 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:46:14.167572 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:14.168417 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:14.174690 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:14.175180 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:14.175605 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:14.176303 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:14.176790 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:14.177224 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:14.308445 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.policy [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132496) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:46:14.316165 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-0bfd0665-4842-40ee-80ee-be288e4460ec tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1577 microversion: 2.1 time: 0.152736 Sep 01 00:46:14.316778 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 509/1020] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:14 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:46:15.337350 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:15.338048 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:15.345114 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:15.345596 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:15.346028 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:15.346723 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:15.347166 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:15.347583 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:15.487250 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.policy [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '048aba7c5b364b07abf7f6b8977d167a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31e9903e4f16471d8057ee7364cf123b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=132498) authorize /opt/stack/nova/nova/policy.py:199}} Sep 01 00:46:15.495724 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-6430fdc6-f02d-482b-869b-7e303d9b999e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 200 len: 1459 microversion: 2.1 time: 0.162209 Sep 01 00:46:15.496536 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 512/1021] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:15 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 1459 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 01 00:46:15.623212 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [req-439c25bd-83b2-48cf-bde7-2befaf54e563 req-49a22920-d748-4dd1-84d4-56bfc0e4f516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e8e6f70-6e87-47d0-8d38-75dad700ec31", "name": "network-vif-deleted", "tag": "6298d4b7-4066-46b0-b87e-46e160ffece2"}]} {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 01 00:46:15.635582 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-439c25bd-83b2-48cf-bde7-2befaf54e563 req-49a22920-d748-4dd1-84d4-56bfc0e4f516 service nova] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:15.636068 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-439c25bd-83b2-48cf-bde7-2befaf54e563 req-49a22920-d748-4dd1-84d4-56bfc0e4f516 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:15.636746 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [req-439c25bd-83b2-48cf-bde7-2befaf54e563 req-49a22920-d748-4dd1-84d4-56bfc0e4f516 service nova] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:15.648241 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.compute.server_external_events [req-439c25bd-83b2-48cf-bde7-2befaf54e563 req-49a22920-d748-4dd1-84d4-56bfc0e4f516 service nova] Creating event network-vif-deleted:6298d4b7-4066-46b0-b87e-46e160ffece2 for instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 on hv-cinder-82002 Sep 01 00:46:15.653987 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [req-439c25bd-83b2-48cf-bde7-2befaf54e563 req-49a22920-d748-4dd1-84d4-56bfc0e4f516 service nova] 10.222.0.25 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094112 Sep 01 00:46:15.654764 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 510/1022] 10.222.0.25 () {64 vars in 1317 bytes} [Thu Sep 1 00:46:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 01 00:46:16.518199 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:16.518881 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: 2e8e6f70-6e87-47d0-8d38-75dad700ec31] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:16.525369 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:16.525845 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:16.526279 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:16.526958 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:16.527405 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:16.527822 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:16.543075 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] HTTP exception thrown: Instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 could not be found. Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Request method failure captured: Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 HTTP/1.1 Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_9IH0IwAzBl9XtT4XVAgHTZO2_cm7kJGpW0qkv7LamO2PFAoB5PSQm2hZAvqlt7GheNl2c83_1v2m7qTytI7H3lVAm7lRl7KysB3WJf4VVCJnDDgkxPI0HD4BYCF30Gz86_RcD6X3bs-EfA-BG9YDnbEjDo56lPbntdKI0XGD2wor0 Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:46:16.544930 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}] Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 048aba7c5b364b07abf7f6b8977d167a Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 could not be found. Sep 01 00:46:16.546720 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': '2e8e6f70-6e87-47d0-8d38-75dad700ec31'} Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 could not be found. Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:46:16.547921 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 could not be found. Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 could not be found. Sep 01 00:46:16.549816 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:16.551503 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Returning 404 to user: Instance 2e8e6f70-6e87-47d0-8d38-75dad700ec31 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:46:16.551503 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-33916c4e-0570-43c8-8941-7634f0ce301e tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31" status: 404 len: 111 microversion: 2.1 time: 0.032024 Sep 01 00:46:16.551503 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 513/1023] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:16 2022] GET /compute/v2.1/servers/2e8e6f70-6e87-47d0-8d38-75dad700ec31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:46:16.984814 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:16.985408 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.compute.api [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132496) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:16.992337 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:16.992865 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:16.993305 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:16.994003 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:16.994458 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:16.994894 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG oslo_concurrency.lockutils [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132496) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:17.008433 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.wsgi [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] HTTP exception thrown: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Request method failure captured: Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: request: DELETE /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 HTTP/1.1 Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept: application/json Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Accept-Encoding: identity Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Connection: close Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Length: 0 Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Content-Type: application/json Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Host: 10.222.0.25 Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: Openstack-System-Scope: None Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: User-Agent: python-urllib3/1.26.12 Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Auth-Token: gAAAAABjD_9IH0IwAzBl9XtT4XVAgHTZO2_cm7kJGpW0qkv7LamO2PFAoB5PSQm2hZAvqlt7GheNl2c83_1v2m7qTytI7H3lVAm7lRl7KysB3WJf4VVCJnDDgkxPI0HD4BYCF30Gz86_RcD6X3bs-EfA-BG9YDnbEjDo56lPbntdKI0XGD2wor0 Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Id: None Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Domain-Name: None Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Identity-Status: Confirmed Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Is-Admin-Project: True Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Id: default Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Domain-Name: Default Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Project-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Role: member,reader Sep 01 00:46:17.010107 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Roles: member,reader Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}] Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Id: default Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Domain-Name: Default Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Id: 048aba7c5b364b07abf7f6b8977d167a Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: X-User-Name: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: method: > Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: exception: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.011854 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: action_args: {'id': 'c472673e-4179-483d-a44f-d9a4fe49b434'} Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:46:17.013730 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.015593 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.017621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Returning 404 to user: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. {{(pid=132496) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:46:17.017621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-79365a16-fe3c-409e-9884-876193ae792c tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "DELETE /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 404 len: 111 microversion: 2.1 time: 0.031177 Sep 01 00:46:17.017621 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 511/1024] 10.222.0.25 () {58 vars in 1239 bytes} [Thu Sep 1 00:46:16 2022] DELETE /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:46:17.021120 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '>' {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:17.021732 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.compute.api [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] [instance: c472673e-4179-483d-a44f-d9a4fe49b434] Fetching instance by UUID {{(pid=132498) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 01 00:46:17.027575 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:17.028050 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:17.028551 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:17.029418 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Acquiring lock "e166cc96-51e7-4aca-853f-51af32260464" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 01 00:46:17.029863 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 01 00:46:17.030282 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG oslo_concurrency.lockutils [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Lock "e166cc96-51e7-4aca-853f-51af32260464" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=132498) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 01 00:46:17.043543 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.wsgi [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] HTTP exception thrown: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Request method failure captured: Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: request: GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 HTTP/1.1 Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept: application/json Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Accept-Encoding: identity Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Connection: close Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Length: 0 Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Content-Type: application/json Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Host: 10.222.0.25 Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: Openstack-System-Scope: None Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: User-Agent: python-urllib3/1.26.12 Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Auth-Token: gAAAAABjD_9IH0IwAzBl9XtT4XVAgHTZO2_cm7kJGpW0qkv7LamO2PFAoB5PSQm2hZAvqlt7GheNl2c83_1v2m7qTytI7H3lVAm7lRl7KysB3WJf4VVCJnDDgkxPI0HD4BYCF30Gz86_RcD6X3bs-EfA-BG9YDnbEjDo56lPbntdKI0XGD2wor0 Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Id: None Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Domain-Name: None Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Identity-Status: Confirmed Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Is-Admin-Project: True Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Id: default Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Domain-Name: Default Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Project-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Role: member,reader Sep 01 00:46:17.045142 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Roles: member,reader Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.25:8080", "publicURL": "http://10.222.0.25:8080/v1/AUTH_31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.25/volume/v3/31e9903e4f16471d8057ee7364cf123b"}]}] Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Id: 31e9903e4f16471d8057ee7364cf123b Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-Tenant-Name: tempest-TestVolumeBootPattern-1411551411 Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Id: default Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Domain-Name: Default Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Id: 048aba7c5b364b07abf7f6b8977d167a Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: X-User-Name: tempest-TestVolumeBootPattern-1411551411-project Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: method: > Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: exception: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.047033 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: action_args: {'id': 'c472673e-4179-483d-a44f-d9a4fe49b434'} Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: {{(pid=132498) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 01 00:46:17.048178 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. Sep 01 00:46:17.049856 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: ERROR nova.api.openstack.wsgi Sep 01 00:46:17.051358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: DEBUG nova.api.openstack.wsgi [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Returning 404 to user: Instance c472673e-4179-483d-a44f-d9a4fe49b434 could not be found. {{(pid=132498) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 01 00:46:17.051358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: INFO nova.api.openstack.requestlog [None req-96d28838-7d23-4416-9d46-99f72d6b00bf tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434" status: 404 len: 111 microversion: 2.1 time: 0.029217 Sep 01 00:46:17.051358 dv-cinder-820027-21-iscsi devstack@n-api.service[132498]: [pid: 132498|app: 0|req: 514/1025] 10.222.0.25 () {58 vars in 1236 bytes} [Thu Sep 1 00:46:17 2022] GET /compute/v2.1/servers/c472673e-4179-483d-a44f-d9a4fe49b434 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 01 00:46:18.339945 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: DEBUG nova.api.openstack.wsgi [None req-bf24921a-cc2b-403e-9848-af2148528480 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] Calling method '.version_select at 0x7fcadfe7d310>' {{(pid=132496) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 01 00:46:18.365529 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: INFO nova.api.openstack.requestlog [None req-bf24921a-cc2b-403e-9848-af2148528480 tempest-TestVolumeBootPattern-1411551411 tempest-TestVolumeBootPattern-1411551411-project] 10.222.0.25 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2019141328" status: 202 len: 0 microversion: 2.1 time: 0.029800 Sep 01 00:46:18.366389 dv-cinder-820027-21-iscsi devstack@n-api.service[132496]: [pid: 132496|app: 0|req: 512/1026] 10.222.0.25 () {58 vars in 1263 bytes} [Thu Sep 1 00:46:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-2019141328 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)